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§1. Introduction 

1.1. Given a field K and a representation p of a group to SL(2, K), the character of the 
representation sends a group element g to the trace of the matrix p{g). One of the result of the 
paper is the following, 

Theorem. Suppose K is a field so that each quadratic equation with coefficients in K has 
a root in K. Then a K-valued function defined on a group is the character of an SL(2,K) 
representation of the group if and only if its restriction to each 2-generator subgroup is an 
SL(2,K) character. 

The SL(2, K) characters on 2-generator groups are well understood since the work of Fricke- 
Klein [FK] and Vogt [Vo]. They are governed by the trace identity: tr(AB) + tr(A~ 1 B) — 
tr(A)tr(B) for SL(2, K) matrices A, B. In [Hel], Helling gave an elegant axiomatic approach to 
characters based on the above trace identity. Following Helling, a -fT-valued function / defined 
on a group G is called a K-trace function if (1) f(xy) + f(x~ 1 y) = f(x)f(y) for all x,y in 
G and (2) f(id) = 2 where id is the identity element. Evidently an SL(2,K) character is a 
-KT-trace function. Using the work of [FK], [Hel] and [Vo] that X-trace functions are characters 
on 2-generator groups, one deduces the following result equivalent to the above theorem. 

Corollary. Suppose K is a field so that each quadratic equation with coefficients in K has 
a root in K . Then a K-valued function f defined on a group is the character of an SL(2, K) 
representation of the group if and only if f(xy) + f(x~ x y) = f(x)f(y) for all x,y in the group 
and f(id) = 2. 

This generalizes a result of Helling [Hel] who proved that R-trace functions are SL(2, R) 
characters under some additional assumptions. 

1.2. The main result of the paper which implies theorem 1.1 gives a characterization of 
SL(2, K) characters defined on the fundamental groups of surfaces using subsurface groups. 
In contrast to theorem 1.1 which uses the hierarchy of subgroups indexed by the number of 
generators to describe the characters, there exists a natural hierarchy of surfaces under inclusion 
indexed by the level. Recall that the level of a compact surface of negative Euler number is the 
minimal number of disjoint simple loops decomposing the surface into 3-holed spheres. It is also 
the complex dimension of the Teichmuller space of complex structures on the interior of the 
surface with punctured ends. For instance, the 3-holed sphere has level-0 and the 4-holed sphere 
and the 1-holed torus have level-1. This hierarchy of surfaces is prominent in Grothendieck's 
manuscript [Gr] and conformal field theory [MS]. In particular, Grothendieck conjectured that 
the "tower of Teichmuller spaces" can be reconstructed from the Teichmuller spaces of level-1 
surfaces subject to the relations supported in level-2 surfaces. Motivated by this Grothendieck's 
reconstruction principle, one asks if a character can be reconstructed from its restriction to the 
fundamental group of each level-1 subsurface. The main result of the paper gives a complete 
answer to this question. 

To give a precise solution to the above question, we shall first note that the fundamental 
group is not vital with respect to the hierarchy. Indeed, if a given element in the fundamental 
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group is "complicated" in the sense that it has no representative in any level- 1 subsurface, then 
the condition becomes null about the class. Thus, we focus our attention to those "simple" 
elements in the fundamental group. This motivates the introduction of the set S(E) of free 
homotopy classes of unoriented homotopically non-trivial simple loops on a surface E. The 
space S(E) was introduced by Max Dehn [De] in his study of the mapping class groups and was 
independently introduced by Thurston [Th] in his work on surface theory. If / is an SL{2, K) 
character defined on the fundamental group of a surface E, then / induces a K- valued function 
on S'(E) which we still call an SL(2, K) character. A natural property of a character / on S'(E) 
is that its restriction to each subsurface is again a character. To be more precisely, if E' is 
an essential subsurface (i.e., the inclusion map induces a monomorphism between fundamental 
groups), then the restriction map /oi, is again a character on S'(E') where : S^E') — > S'(E) 
is induced by the inclusion. 

We call a if-valued function / defined on the set S'(E) of homotopy classes of simple loops 
a trace function if the restriction of the function to each S(E') is a character for each level-1 
essential subsurfaces E'. Grothendieck's principle predicts that a trace function is a character. 
The main result of the paper shows that this holds except for finitely many exceptional trace 
functions defined on genus zero surfaces when the characteristic of the field K is not 2. All 
exceptional trace functions are derived from a single one defined on the 5-holed sphere which we 
describe as follows. Let the characteristic of the field K be not 2 and b±, 65 be the boundary 
components of the 5-holed sphere Eq^. Define fo : 5 , (Eq ) 5) — > K by sending each hi to 2 and all 
other elements to —2. One checks easily (see §5.4) that fo is a trace function which is not the 
character of any representations. There are sixteen exceptional trace functions / on the 5-holed 
sphere all derived from fo. Namely, an exceptional trace function f : 5 , (Eo,s) — > K satisfies the 
following (1) /(S(E , 5 )) = {2, -2}, (2) nf =1 /(6,) = 32, and (3) if a is a non-boundary parallel 
class so that a, hi, and bj bound a 3-holed sphere, then f(a) = — \f{bi)f{bj). 

The main result of the paper is the following. 

Theorem. Suppose K is a field so that each quadratic equation with coefficients in K has 
a root in K. Let f be a K-valued trace function defined on the set >S(E) of homotopy classes of 
essential simple loops in a compact orientable surface E. 

(1) If the characteristic of the field K is 2, then the trace function f is the character of an 
SL(2,K) representation. 

(2) If the characteristic of the field K is not 2, then 

(2.1) either f is the character of an SL{2,K) representation, or 

(2.2) the genus of the surface E is zero, f takes only values {2,-2}, and there is a level- 2 
subsurface so that the restriction of f to the subsurface is one of the sixteen exceptional trace 
functions. 

(2.3) There exist exceptional trace functions on each genus zero surface of level at least 2. 
The the number of exceptional trace functions on a fixed surface is finite. 

Note that surfaces in the theorem are connected and could be compact or non-compact of 
infinite type. 
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Theorem 1.2 does not cover the case when the surface E has level at most 1. The charac- 
terization of SL(2, K) characters on the set of simple loops in level-1 surfaces (propositions 3.4 
and 3.5) is well known by the work of [FK], [Go], [Hel], [Ho], [Ma], [Vo] and others. It is based 
on the following lemma (lemma 2.3) well known to the experts in the field. Namely, given six 
elements xi, X2, £3, ^12, £23, ^31 in K, there exist three SL(2, K) matrices Ai, A2, an As so that 
tr(Ai) = Xi and tr(AiAj) = Xij. 

1.3. Given a group G and a field K, the set of all SL(2,K) characters on G is called 
the character variety of the group. Theorem 1.1 gives an explicit algebraic description of the 
character variety of the group for those field K satisfying the condition in the theorem. If the 
group G is finitely generated, then a well known result (proposition 2.2) shows that there exists 
a finite subset FcGso that each SL(2, K) character on the group is algebraically determined 
by its restriction to the finite set F. As a consequence of these and the Hilbert basis theorem, 
one obtains the following corollary which slightly generalizes a result of Culler-Shalen [CS] who 
proved it for algebraically closed field K. 

Corollary (Culler-Shalen). Suppose G is a finitely generated group and K is a field so that 
each quadratic equation with coefficients in K has a root in K. Then the set of all SL(2,K) 
characters on the group forms an affine algebraic variety defined over K. Furthermore, the 
defining equations are integer coefficient polynomials. 

In [GM], Gonzalez-Acuna and Montesinos-Amilibia gave a constructive proof of Culler- 
Shalen's result. Their proof also shows the above corollary in the case the characteristic of K is 
not 2. 

The assumption on the quadratic closeness of the field K can be replaced by extension 
fields. Namely, suppose K is any field and / is a K-trace function defined on a group generated 
by n elements. Then there exists an extension field F of K obtained from K by at most n 
quadratic extensions and a representation of the group to SL{2, F) whose character is the given 
K-trace function. 

1.4. There exists an interesting analogy between the hierarchy of finitely generated groups 
indexed by the number of generators and the hierarchy of surfaces indexed by the level. It 
seems that the role of level-1 surfaces is similar to that of 2-generator groups. For instance, 
Jorgensen [Jo] proved that a non-elementary subgroup of SL(2, C) is discrete if and only if each 
2-generator subgroup is discrete. A consequence of [Lul] shows that a faithful representation 
of a surface group to SL{2, R) is discrete if and only if the restriction of the representation 
to each level-1 subsurface group is discrete and uniformizes the subsurface. Theorems 1.1 and 
1.2 provide another comparison. Here is a third pair. Recall that a subgroup in SL(2,K) is 
reducible if it leaves a 1-dimensional linear subspace in K 2 invariant. It is known [CS] that 
a subgroup in SL(2, K) is reducible if and only if each 2-generator subgroup is reducible (see 
§2.5). The analogous result is the following. 

Theorem. An SL(2, K) representation of a surface group is reducible if and only if its 
restriction to each level-1 subsurface group is reducible. 

In fact, in the statement of the theorem, 3-holed sphere and 1-holed torus subgroups suffice. 
However, there exists an irreducible representation of a surface group to SL{2, K) so that the 



3 



restriction to each level-0 subsurface group is reducible. Such irreducible representations occur 
rarely (only on genus 1 surfaces) and are classified in §6 and §7. 

Finally, the analogous result to the well known proposition 2.2 is the following (see §3.9) 
that there exists a finite set of homotopy classes of simple loops on each compact orientable 
surface so that the characters of SL(2, K) representations are algebraically determined by their 
restrictions to the finite set. 

1.5. Since each compact 3-manifold has a Heegaard splitting, a 3-manifold group is the 
quotient of a surface group by a subgroup of the form N1N2 where each Ni is normally generated 
by disjoint simple loops. This shows that simple loops are characteristic for 3-manifold groups 
(among all finitely presented group). By singling out the special feature of simple loops in 
theorem 1.2, it is hoped that it will have some applications to 3-manifold groups. In particular, 
we are motivated by the following question. Given a Haken 3-manifold M, does there exist an 
irreducible SL(2, K) representation of the fundamental group of the 3-manifold for some finite 
field Kl See [Hem] for related topics. 

1.6. As mentioned before, theorem 1.2 may be interpreted as establishing Grothendieck's 
reconstruction principle for SL{2) character varieties. Broadly speaking, the principle says that 
to study the isotopy class of a structure on a surface, one should consider the restriction of the 
structure to the isotopy classes of all level- 1 subsurfaces and reconstruct the original isotopy 
class of the structure from the restrictions. Furthermore, level-2 subsurfaces should serve as the 
"relators" in the reconstruction process (see [Gr] and [Lu4]). This reconstruction principle is 
shown to be valid for hyperbolic metrics and measured laminations in [Lul] and [Lu2] . The proof 
of theorem 1.2 is similar to the proof of [Lul]. Namely, first we prove the result for level-1 and 
level-2 surfaces and then we prove the result for all surfaces using a general gluing lemma. The 
main difficulty in proving theorem 1.2 is caused by the existence of irreducible representations 
whose restrictions to some 2-generator subgroups are reducible. Similarly, the main difficulty in 
establishing theorem 1.1 is in the case of free group on 4 generators. 

1.7. The study of the algebra of characters of <SX(2, K) representation was started by Vogt 
and Fricke-Klein and is developed by many authors [BG], [BH], [CS], [Hel], [Ho], [Ke], [LM], 
[Ma], [Pr], [Sa] and others. It seems that there is a close relation between what we did here and 
those algebraic approach to the ring of SL{2) characters on a group. 

1.8. The organization of the paper is as follows. In §2, we recall the basic facts on traces 
of SL(2,K) matrices and group representations. In §3, we recall the basic facts on simple 
loops on surfaces and the modular structure. We then use the modular structure to describe 
SL(2, K) characters on level-1 surfaces. A multiplication of the simple loops on surfaces will 
also be discussed. In §4 and §5, we prove the main result for the genus zero surfaces by making 
extensive use of the modular structure. In §6, we prove theorem 1.2 for the 2-holed torus. 
Theorem 1.2 for all surfaces is proved in §7. In §8, we prove theorem 1.1. In the final section 
§9, we discuss some questions arising from the consideration of SL(2) characters. 

1.9. Acknowledgment. I would like to thank F. Bonahon and X.-S. Lin for many discussions. 
This work is supported in part by the NSF. 

§2. Preliminaries on SL(2,K) Matrices 
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In this section, we shall introduce notations and recall basic trace identities. 

2.1. We shall use the following notations and terminologies. A representation p of a group 
G to SL(2, K) is called reducible if there exists a 1-dimensional linear subspace in K 2 invariant 
under the linear action of G. Otherwise the representation is called irreducible. Two represen- 
tations pi and pi of a group G to SL(2, K) are conjugate if there exists a matrix X in SL(2, K) 
so that for all g <E G, X pi^X -1 = p 2 (g). Evidently, conjugate representations have the same 
characters. A reducible representation is called diagonalizable if it is SL(2,K) conjugate to a 
representation whose image lies in the set of diagonal matrices. The character of a reducible 
(resp. irreducible) representation is also called reducible (resp. irreducible). A subgroup of 
SL(2, K) is called reducible if the inclusion map is reducible. 

2.2. The following trace identities will be used frequently. They are derived from the first 
identity (a). The earliest source of these identities seems to be [Vo]. For instance, the less 
commonly used identity (d) is on page Sll in [Vo]. See [FK], [Go], [Vo] and others for a proof. 

Lemma. Let R be a commutative ring with identity. Suppose A, B, Ai, Bi are SL(2,R) 
matrices where i = 1,2, 3. Then the following identities hold. 

(a) tr(AB) + tr{A- x B) = tr{A)tr(B). 

(b) tr 2 (A) + tr 2 (B) + tr 2 (AB) - tr(A)tr(B)tr(AB) = tr([A, B]) + 2. 

(c) Let A 4 = A lf A 5 = A 2 , P = Y^ =1 tr{Ai)tr{A i+l A i+2 ) - tr{A x )tr{A 2 )tr{A z ) and Q = 
Y* =1 {tr 2 {A^+tr 2 {A t A l+1 )-tr{A^tr{A t+1 )^^ Then 
the two roots of the quadratic equation x 2 — Px + Q = are tr(AiA 2 A 3 ) and tr(A^ 1 A^ 1 A 3 ~ 1 ). 

(d) tr(A 1 A 3 )+tr(A 1 A 2 A 3 A- 1 ) = -tr(A 1 A 2 )tr(A 2 A 3 )+tr(A 1 )tr(A 3 )+tr(A 2 )tr(A 1 A 2 A 3 ). 
In §3, these equations will be interpreted using the modular configuration (Q, PSL(2, Z)). 

As a consequence of the lemma, one has the following useful proposition. See [CS], [FK], 
[Ho] and [Vo] for a proof. 

Proposition ([CS], [FK], [Ho] and [Vo]). Given a commutative ring R with identity, the 
trace of a word w(Ai, A n ) in the SL(2,R) matrices Ai,...,A n is a polynomial with integer 
coefficients in the traces of A^.-.A^ where 1 < %\ < ... < i& < n and k < n. 

Remark. If the commutative ring R is a field K of characteristic not equal to 2, then a trace 
identity in [Vo] (page S14, line 19) shows that the trace ir(Ai A2A3A4) can be expressed in terms 
of the traces of Aj, A t Aj, and AiAjA k: 1 < i, j, k < 4. Thus in this case, one can strengthen the 
proposition to tr(Aj 1 ...A ifc ) where 1 < i\ < ... < < n for k < 3. This triple-trace theorem has 
been rediscovered independently by many mathematicians. See [Bu], [BG] and others. 

In [Hel], Helling proved that all trace identities in Lemma 2.2 still hold for i?-trace functions. 
Since the proof of the above proposition uses only identity (a) in lemma 2.2 and tr(id) = 2, 
Helling proved the following corresponding result for .R-trace functions. 

Corollary ([Hel]). Suppose G is a group generated by n elements {xi, x n }. Then for 
each element w G G, there exists an integer coefficient polynomial P w in variables t^...^, 
where 1 < %\ < ... < ik < n for k < n so that for all R-trace functions f on G, f(w) = 

■Xi k 
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an (n+l)-holed sphere 



an n-holed torus 



(a) 



(b) 



Figure 2.1 



In particular .R-trace functions on the free group F n of n generators < x\,...,x n > are 
determined by their restrictions to the set {a^.-.a^J 1 < i\ < ... < it < n and k < n}. Now 
identify the free group F n with the fundamental group 7Ti(Eo, n +i) of the (n + l)-holed sphere or 
7Ti(Ei )n _i) of the (n — l)-holed torus. Then we may choose the set of n generators {xi, ...,x n } 
so that each element x^.-.x^ is represented by a simple loop in the surface (see fig. 2.1.). This 
shows that -R-trace functions on the fundamental groups of these surfaces are determined by 
their restrictions to the classes of simple loops. 

For the low-rank free groups -^2,-^3 and F4, the (2 n — l)-element set {x^.-.a^J 1 < %\ < 
... < ik < n} are closely related to the so called modular relation and pentagon relations on 
the surfaces of genus zero. Indeed, take F 2 = 7ri(E ,3), then the 3-element set {xi,X2,x±X2} is 
represented by the three boundary components. Take F 3 = ^(Eq^). Then the 7-element set 
{xi, } is represented by the four boundary components and three 

simple loops pairwise intersecting at two points (see fig. 2.2). Take F4 = -^(Eo^). Then the 
15-element set {x\, X2, X3, X4, X1X2, ^1^3, X1X4, X2X3, X2X4, x?,x^x\X2X?„x\Xj,x^X2X? > x^x\X2X^ 
X1X2XSX4} is represented by the five boundary components and 10 more simple loops closely 
related to the pentagon relation (see §3.2 and §4 for more discussions). 



6 




Figure 2.2 

2.3. In the rest of the paper, we will always assume that the field K is quadratically closed 
in the sense that each quadratic equation x 1 + ax + b = 0, a, 6 G K has roots in K. Under this 
assumption, each SL(2, K) matrix has eigenvalues in K. Furthermore, two SL(2, K) matrices 
are SL{2, K) conjugate if and only if they have the same trace. 

The following lemma is known to experts in the field. Especially, in the case the field K 
is algebraically closed, it follows from the combination of the work of Culler-Shalen [CS] and 
Horowitz ([Ho], theorem 4.3). Since we have not seen a written proof of the version stated below, 
a proof is given in the appendix for completeness. 

Lemma. Suppose K is a quadratically closed field. Given six elements t±, t 2 , t 3 , ti 2 , ^23 o,nd 
^3i in K , there exist three SX(2, K) matrices A±, A 2 and A 3 so that tr(Ai) = t\ and tr(AiAj) = 
tij . 

Combining the lemma with proposition 2.2 and lemma 2.2(c), one sees that the set of all 
characters on the free group in three generators < xi, x 2 , xs > is the hypersurface {(t±, t 2 , £3, t± 2 , 
£235*315 £123) £ K 7 \ the equation (*) holds}, 

3 3 

(*) *123 + (J! - Yl *<*i*)*123 + E ^ + E l l + II " E " 4 = °- 

i=l i=l 

In the equation (*), ti lm ..i k = tr(p(xi 1 ...Xi k )) and the indices k are pairwise distinct. This 
fact was well known after the work of Culler-Shalen [CS] and Horowitz [Ho]. See §3.5 for more 
details. 
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2.4. It is easy to see that (BA 1 B- 1 ,BA 2 B- 1 ,BA 3 B- 1 ) and (A^ 1 , A^ 1 , A^ 1 ) are other 
solutions in lemma 2.3. In fact, these are the set of all solutions to the the equation tr(Xi) = 
ti, tr(XiXj) = tij if and only if the group generated by < A±, A 2 , A3 > is irreducible. To derive 
this, let us recall the following lemma proved by Culler and Shalen ([CS] lemma 1.5.2). 

Lemma (Culler-Shalen). Suppose the field K is quadratically closed. If pi and p 2 are two 
representations of a group to SL(2, K) so that p\ is irreducible, then p\ is conjugate to p 2 if and 
only if they have the same character functions. 

As a consequence of Culler- Shalen' s lemma, lemma 2.2 and proposition 2.2, we see that if 
the group generated by {Ai, A 2 , As} in lemma 2.3 is irreducible, then the solution (Ai, A 2 , As) 
in lemma 2.3 is unique up to conjugation and inverse. Evidently, if the group < Ai,A 2 ,A 3 > 
in lemma 2.3 is reducible, then the solution is not unique in the above sense. 

2.5. Due to the importance of irreducible representations, we need an irreducibility criterion. 
The following is well known. See [CS] lemma 1.5.5, or [Ma] for instance. 

Lemma. Suppose the field K is quadratically closed. The group < A,B > generated by 
two elements A, B in SL(2, K) is reducible if and only iftr([A, B]) = 2. 

By lemma 2.2(b), the condition in the above lemma is the same as tr 2 (A) + tr 2 (B) + 
tr 2 (AB) - tr(A)tr(B)tr(AB) -4 = 0. Since this expression will occur frequently, following 
[Ma], let us denote tr 2 (A) + tr 2 (B) + tr 2 (AB) - tr(A)tr(B)tr(AB) - 4 by A(A, B). 

As a consequence of the lemma, one has the following criterion for reducibility. A slightly 
different criterion can be found in [CS], [GM] (proposition 4.4) and [Ma]. 

Corollary. Suppose the field K is quadratically closed. 

(a) . The group < A\,A 2 , A3 > generated by three elements A\,A 2 and A3 in SL(2,K) is 
reducible if and only if A(Ai, Aj) = and A(A±, AiA 2 A 3 ) = where = (1, 2), (2, 3), (3, 1). 

(b) . The group < A±, A n > in SL(2, K) generated by n elements is reducible if and only 
if each 3-generator subgroup < Ai.Aj.A^ > is reducible, i.e., for all possible choice of indices 

k, A(Ai, Aj) = and A(A U A t AjA k ) = 0. 

(c) (Culler-Shalen). A subgroup of SL(2,K) is reducible if and only if each 2-generator 
subgroup is reducible. 

Proof. To see part (a), we may assume that none of Ai is ±id since otherwise it reduces to 
lemma 2.5. Thus each Ai has at most two eigenspaces. By lemma 2.5, each pair (Ai, Aj) has 
a common eigenspace for i 7^ j. Now if one of Ai has exactly one eigenspace, then all Ai, A 2 , 
and A3 share this unique eigenspace. Thus the group is reducible. If otherwise, each Ai has two 
distinct eigenspaces Lj and % 7^ j 7^ k 7^ i. Now suppose that the group < Ai, A 2 , A3 > is 
irreducible. Then all three eigenspaces are pairwise distinct, i.e., L\ 7^ L 2 7^ L3 7^ L\. But by 
assumption, A\ and A\A 2 A3 have a common eigenspace L. Due to A\(L) = L, thus L must 
be either L 2 or L3, say, L = L 2 . Then AiA 2 A3(L 2 ) = L 2 implies that A 2 (L 2 ) = L 2 , i.e., L 2 is 
either L\ or L3 which contradicts the assumption. 

Parts (b) and (c) follow from part (a) easily. To see (b), we first drop all generators Ai 
which are ±id. Thus, we may assume that each Ai has at most two eigenspaces. By the 
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assumption, any three elements Ai, Aj, and A k have a common eigenspace. The goal is to show 
that all elements Ai have a common eigenspace. To this end, we form a graph whose vertices 
are eigenspaces of A^s. To each element Ai, we draw an edge ending at the eigenspaces of Ai 
(the edge becomes a loop if Ai has only one eigenspace). Now by the assumption, any three 
edges of the graph has a common vertex. Thus all edges of the graph share a vertex. 

To see part (c), take a subgroup G of SL(2, K) which has the property that each 2-generator 
subgroup is reducible. By parts (a) and (b), we see that each finitely generated subgroup of G 
is reducible. Now by the same graph theoretical argument as in part (b), we see that the group 
G is reducible. □ 

2.6. Given a reducible representation p of a group to SL{2,K), we may assume after 
conjugate p by an SL(2, K) matrix that the image of p is in the set of upper triangular matrices. 
Let p' be a new representation so that p'(g) is the diagonal matrix whose diagonal entries are that 
of p(g). Then the diagonalizable representation p' has the same character as that of p. Evidently 
the diagonal representation is unique up to conjugation. We call p' the diagonalization of the 
reducible representation p. 

Lemma. Suppose K is a quadratically closed field. Let p\ and P2 be two non- diagonalizable 
reducible representations of the free group < x, y > on two generators to SL(2, K). If pi and pi 
have the same character and tr(pi(x)) ^ ±2, then they are conjugate. 

Indeed, under the assumption, we can conjugate the pair (pi(x), p%{y)) to the pair of matrices 




) where A 7^ ±1. 



§3. Simple Loops on Surfaces and the Modular Configuration 

We shall recall some basic facts on the set of isotopy classes of simple loops on surfaces and 
express the results in §2 in terms of a (Q-P 1 , PSL(2, Z)) modular structure on the set S'(E). We 
also establish several irreducible conditions in terms of the modular structure. 

The field K is always assumed to be quadratically closed. 

3.1. The following notations and terminologies will be used. Let E = E ff r be a compact 
orientable surface of genus g with r boundary components. The level of the surface E g r is defined 
to be 3g + r — 3 which is the minimal number of disjoint simple loops decomposing the surface 
into 3-holed spheres. Recall that S'(E) is the set of isotopy (homotopy) classes of unoriented 
homotopically non-trivial simple loops on E. Let 5"(E) be the subset of S'(E) consisting of non- 
boundary parallel isotopy classes. The fundamental group of the surface is denoted by 7Ti(E). 
The isotopy class of a loop s will be denoted by [s] . If b is a boundary component of the surface 
E, we usually use b to denote [b]. Given two isotopy classes a and (3 in S'(E), let I (a, j3) be their 
geometric intersection number which is min{|a fl b\\a G a, b G (3}. If / is a function defined on 
S'(E), we define f(a) = f([a\). In particular, the intersection number I([a], [b]) is also denoted 
by I(a, [b]) = I ([a], b) = I(a,b). We use a _L (3 to denote two elements a, (3 G >S(E) so that 
I(a,(3) = 1. And we use a J_o P to denote two elements a and (3 so that I(a,f3) = 2 and 
their algebraic intersection number is zero. Two elements a, (3 are called disjoint, denoted by 
a fl (3 = 0, if I(a,f3) = and a 7^ (3. If I(a,f3) 7^ 0, we say that a intersects (3. Two isotopic 
curves a, b will be denoted by a = b. 
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Let Q = QU{oo} = QP 1 . Two rational numbers p/q, p'/q' satisfying pq' —p'q = ±1 will be 
denoted by p/q _L p'/q'. The relation (Q, _L) is the so called modular relation. It is well known 
from elementary number theory that one may identify Q with the set of cusps in fig. 3.1 so that 
two cusps are joint by an edge if and only if the corresponding rational numbers r, r' satisfy 
r _L r'. We say three elements (a, (3, 7) in Q form a triangle ifa_L/3_l_7_La and four distinct 
elements (a, /?, 7; 7') form a quadrilateral if both (a, /?, 7) and (a, /?, 7') are triangles (see fig. 
3.1). 




p/q p /q 



Figure 3.1 

We shall always fix an orientation on Q so that the triangle (0, 1, 00) is positively oriented 
(i.e., the right-hand orientation in fig. 3.1). A triangle is positively oriented if it determines the 
fixed orientation. The group of orientation preserving bijection of (Q, _L) is PSL(2, Z) where 
the action of the matrices is given by the fractional linear transformations. 

The importance of (Q, SX(2, Z)) in surface theory was predicted by Grothendieck in [Gr] 
(page 11, second paragraph). 

3.2. Suppose E is a level-1 surface E 1;1 or E 0) 4. Then there exists a bijection (a slope map) 
tv : S"(E) — > Q = QU {00} so that ir(a) — p/q and ir{j3) = p'/q' satisfy pq' —p'q = ±1 if and only 
if I(a,f3) = 1 for E = E^i and I(a,f3) =2 for E = E 0) 4. This important fact was established 

' V 
q 



by M. Dehn [De] by using Dehn's coding 



of classes in 5"(E). 



Here is one way to construct a slope map n : <S"(E) — > Q. It is well known that for the 
torus Ei 5 o, 5'(Ei i o) can be naturally identitied with the set of primitive elements in the first 
homology group i?i(Ei i,Z) modulo ±1. Thus, by fixing a basis for the first homology group, 
one constructs a slope map tt : 6 , (E 1)0 ) — > Q- For the 1-holed torus E 1;1 , let i be an inclusion map 
from E11 to Ei o- Then the induced map from 5"(Ei i) to ^(Ei o) is a bijection preserving 
the relation _L. Thus a slope map for 5"(Ei i) is the composition n o i^. For the 4-holed sphere 
Eq 5 4, there exists a natural bijection P : £'(£0,4) ~~ *■ ^'(£1,1) so that P{ot) _L P((S) if and only 
if a ±0 P- The bijection P is constructed as follows. Let T : E^i — > Ei 5 i be a hyperelliptic 
involution. It is well known that T(s) = s for any simple loop s. Let Eq,4 be the quotient 
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space £1,1/0; ~ T(x) with a regular neighborhood of the branch points removed. Then for each 
[a] E 5"(E 0) 4) the inverse image of a in E^i consists of two disjoint simple loops b and T(b). 
Define -P([a]) = [b]. Thus a slope map for £ ,4 is n o o P. 

Just like in the modular configuration, for a level- 1 surface E, we can talk about triangles 
and quadrilaterals in <S"(£). Furthermore, when the surface E is oriented, by making all maps 
7r, i and P orientation preserving, we can talk about oriented triangles in <S"(£). 



Y = «P Y = Boc 




Right-hand orientation on the front faces 
Figure 3.2 

The relationship between the fundamental group and the modular structure on S(E) can 
be described as follows. For the 1-holed torus £i,i, if (a, /?, 7; 7') is a quadrilateral in £"(£1,1), 
then we can choose generators a, b in the fundamental group 7Ti(Ei i) so that a, /?, 7, and 7' 
are represented by a, 6, a& and a _1 6 respectively (see fig. 3.2). By proposition 2.2, the values of 
an SL(2,K) character on S'(Ei j i) is determined by its restriction on a triangle. 

For the 4- holed sphere Eo,4, if (a, /?, 7; 7') is a quadrilateral in S"(Eo,4), then we can choose 
three generators x\,X2,xs in the fundamental group 7Ti(Ei i) so that (1) the four boundary 
components of the surface are homotopic to x\,X2,X3 and X1X2X3 and (2) the classes a, /?, 7 
and 7' are represented by x±X2, ^2^3, X1X3 and xiX2X3X^ 1 (see fig. 3.3(a)). By proposition 2.2 
for 3-generator groups, it follows that an SL(2,K) character defined on £(£0,4) is determined 
by its restriction to a triangle and the four boundary components. 

Thus triangles, quadrilaterals and boundary components in S^Eq^) and 5 , (Ei i) are exactly 
the elements appeared in lemma 2.2. One advantage of using the modular configuration is the 
symmetry in the modular configuration. For instance, each triangle in the modular configuration 
£(£0,4) is invariant under all permutations of the four boundary components (see fig. 3.3(b)). 
As a consequence, there exists a 24-fold symmetry in the equation (c) in lemma 2.2. 
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X 1 X 2 X 3 X 3 



y = a(3 



Right-hand orientation on the front faces 
Figure 3.3(a) 
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the Seifert surface is z u 



the truncated sphere 



The three-fold symmetry in the modular configuration 
Figure 3.3(b) 

In the following, we shall give a necessary and sufficient condition for a K-valued function 
defined on S(E) to be a character by translating information on the fundamental group 7i"i(£) 
to £(£). These results are certainly well known (see for instance [Go], [Ho ], [Ma], [GM] and 
others). The only novelty is that it is formulated in terms of the modular configuration. 

3.3. For the level-0 surface So, 3, its fundamental group is the free group on 2-generator 
< x, y > where x, y and xy represent the three boundary components bi, 62 and 63. Furthermore, 
we have £(£0,3) = {bi, &2, ^3}- By proposition 2.2, lemmas 2.3 and 2.5, one obtains the following 
result (see [Go]). 

Proposition . Suppose <9£o,3 = &1U62U63. Any function f : £(£0,3) ^ K is an SL(2,K) 
character. Furthermore, the character is reducible if and only i/X)i=i f 2 (bi) — f {b\) f {bz) f {b%) = 
4. 

By a simple calculation and by lemma 2.6, one obtains the following. 
Corollary. Under the same assumption as above, 



(a) if f : S(£ , 



K satisfies f 2 (bi) = 4, then f is reducible if and only if f(bs) 



/(&i)/(&2)/2 when the characteristic of K is not 2 and fib^) = fipz) when the characteristic of 
K is 2. In particular, if the characteristic of K is not 2, and f 2 {bi) = / 2 (&2) = 4, then f is 
reducible if and only if f (bi) f (bz) f (b^) = 8. 

(b) If f : £(£0,3) — > K is a reducible representation so that f 2 (pi) 7^ 4, then there exist 
exactly two SL(2,K) conjugacy classes of SL(2, K) representations whose characters are f. 
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3.4. For the 1-holed torus, we have, 

Proposition. Let b = <9£i,i. A function f : S^E^i) — > K is an SL(2, K) character if and 
only if the following hold. 



(a) J2f 2 (a l )-Hf(a l )-f(b) = 2 and 

(b) f(a s ) + f(a' 3 ) = f(a 1 )f(a 2 ) 
where (cki, a 2 , 0:3) and (a\, a 2 , a' 3 ) are distinct triangles in 5"(Ei ; i). 

The character f is reducible if and only i/X)i=i f 2 ( a i) ~~ E[i=i f( a i) —4 = 0. 

Proof. The necessity of the conditions follow from the trace identities in lemma 2.2 and 
the choice of generators for the fundamental group in §3.2 (see fig. 3.2). Due to the modular 
relation, if fi and f 2 are two functions satisfying equation (b) in the proposition so that they 
coincide when restricted to a triangle, then fi = f 2 . Thus the sufficiency of the condition follows 
from lemma 2.3. □ 

Corollary. Suppose f is an irreducible SL(2,K) character defined on the set S^E^i). 
Then either there exists a 3-holed sphere E' in £^1 so that the restriction /|s(S') ^ s irreducible 
or the characteristic of K is not 2 and /(dE^i) = —2 and f(a) = for all a G S"(Ei ; i). 
Furthermore, if the characteristic of K is not 2, there exists an irreducible representation p of 
7ri(Ei 5 i) so that trp(a) = and trp(dT,i t i) = —2 for all a G S"(Ei 5 i). 

Proof. Let the boundary of E^i be b. By the irreducible assumption, f(b) 7^ 2. Suppose 
otherwise that the restriction of / to each 3-holed sphere is reducible. Since each essential 3- 
holed sphere is bounded by b and two copies of a G 5"(Ei i), by lemma 2.5, we have 2f 2 (a) + 
f 2 (b) - f 2 (a)f(b) = 4 for all a G S'(E M ). Since f(b) ^ 2, this shows that f 2 (a) = f(b) + 2 
for all a G ^'(Ei^). Now take three elements cti G ^(E^i) forming a triangle in the modular 
configuration. By the above proposition and f 2 (cti) = f(b) + 2, we obtain / 2 (o!i)(3 — /(ctj)) = 
f 2 (ai). Thus either (1) /(«;) = and f(b) = -2 or (2) f(a t ) = 2 and f(b) = 2. But the 
case (2) and the case (1) when the characteristic of K is 2 are excluded by the irreducibility 
assumption. 

If the characteristic of K is not 2, then one constructs an SL(2, K) representation of 
7r 1 (E ljl ) satisfying the above condition as follows. First we note that the unit quarternion 

group of eight elements {±1, ±i,±j,±k} is a subgroup of SL{2,K) where i = ^ ^^J and 

Now the character of any representation of 7Ti (E11) onto the unit quar- 



-V-l 

ternion group takes value zero on 5"(Ei i) and —2 on the boundary component. Any two such 
representations are SL(2,K) conjugate. □ 

3.5. For the 4-holed torus, we have, 
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Proposition. Let <9E ,4 = ^f=ih- A function f : 5 , (E ,4) ^ K is an SL(2,K) character 
if and only if for each triangle (a\, a 2 , 0:3) in 5"(E 0) 4) the following hold. 

3344 

(a) E/ 2 (^) + n/(^) + E/ 2 (M + II/(M- E /K)/(M/(M-4 = o 

i=l i=l r=l r=l (i,r,s)EP 

where P ={ (i,r,s) \(ai,b r ,b s ) bounds o Ej^} and, 

(b) /(a 3 ) + = -/(ai)/(a 2 ) + + /(W(&0 

where (3,i,j) and (3,k,l) are in P. 

A character is irreducible if and only if there is a 3-holed sphere so that the restriction of f 
to the 3-holed sphere is irreducible. 

Proof. The necessity of the conditions follow from the trace identities in lemma 2.2 and the 
choice of generators for the fundamental group in §3.2 (see fig. 3.3). 

To show the sufficiency of the conditions, we first note that by the modular relation and 
the iteration equation (b), each / is determined by its restriction to a 7-element set {oti,b r \i = 
l,2,3;r = 1,2,3,4} where a^s form a triangle. We choose a set of generators Xi for the 
fundamental group 7Ti(Eo,4) as in §3.2 so that a k is represented by XiXj, i 7^ j 7^ k 7^ i. Let 
U = f(bi) and Uj = f(a k ) where % = 1,2,3, = (1, 2), (2, 3), (3, 1) and k ^ i ^ j ^ k. By 
lemma 2.3, we find A, G SL(2, K) so that tr(Ai) = ti and tr(Aij) = tij. By equation (a), f(b^) 
is a root of the quadratic equation x 2 — Px + Q = where P and Q are the same as in lemma 
2.2. By lemma 2.2 (c), we may assume after change (Ai, A 2 , A3) to (A^ 1 , A^ 1 , A^ 1 ) if necessary 
that /(kt) = tr(AiA 2 A3). Define a representation of 7ri(E ,4) by sending the generator Xi to 
Ai. Then the character of this representation and the function / take the same values on the 
seven specific elements. Thus they are the same. 

The irreducibility condition follows from corollary 2.5(a). □. 

Corollary, (a) Suppose f is an irreducible character defined on S^Eq^). Then for any 
element a G 5"(Eo ; 4), there exists an element f3 with I (a, (3) = 2 and a 3-holed sphere E' 
bounded by (3 and two components of <9E so that the restriction f\s(z') is irreducible. 

(b) Let b be a boundary component of <9Eo 5 4 and p be an irreducible representation of 
7Ti(Eo,4). If p(b) 7^ ±id, in particular if trp(b) 7^ ±2, then there exists a level- subsurface 
E' having b as a boundary component so that the restriction of p to E' is irreducible. 

(c) If an SL(2, K) representation o/7ri(Eo, n ) is reducible on each lev el- subsurface group, 
then the representation reducible. 

(d) If f is a reducible character on >S(Eo4), then for any quadrilateral (a, (3, 757') in 

5'(E , 4 ),/(7) = /(7 / )- 

Proof. To prove (a), suppose otherwise that / is reducible on each level-0 subsurface E' 
in E 0) 4 bounded by a simple loop intersecting a at two points. Then take a quadrilateral with 
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vertices (a, (3,a(3; (3a) Choose three generators {xi,x 2 ,x 3 } for 7Ti(£o,4) as in fig. 3.3 so that 
(3, a/3, /3a are represented by £2^3, 07x3, and xix^sx^ 1 ■ Let the SL(2,K) representation 
corresponding to the character / send Xi to the matrix and let A4 = AiA 2 A 3 . Since the 
representation is reducible over six 3-holed spheres bounded by a(3 and (3a, we obtain the 
following reducible equations by lemma 2.5. Namely, A(Ai, As) = A(A2, As) = A(A2, A±A 3 ) = 
A(As,A 1 A 2 A 3 A 2 - 1 ) = 0. 

It turns out that these four equations imply that the group < A±, A2, As > is reducible. In- 
deed, if As = ±id, then A(A 2 , A X A 3 ) = A(A 2 , A x ) = shows that the group < A 1 , A 2 , A 3 >=< 
Ai, A 2 ,±id > is reducible by lemma 2.5. Suppose As has exactly one eigenspace. Then 
A(Ai,As) = A(A 2 ,A 3 ) = imply that the eigenspace is fixed by both A\ and A2. Thus 
the group is again reducible. Finally, suppose As has exactly two distinct eigenspaces L\ and 
L 2 so that none of Lj is fixed by both A\ and A 2 . Since A(A 3 , Aj) = for % = 1,2, we may 
assume that Ai(LA = Li for i = 1,2. By A(A 3 , A 1 A 2 A 3 A^ 1 ) = 0, one of the eigenspace Li is 
fixed by A1A2ASA2 1 . If AxA-zA^A^ 1 {L 2 ) = £2, then Ai(L 2 ) = L 2 . Thus the group has a com- 
mon eigenspace L 2 and is reducible. If A\A 2 A2,A~^ X (Li) = then A 3 (A 2 ~ 1 (Li)) = A 2 ~ 1 (Li). 
Thus either A 2 ~ 1 (Li) = Li or A 2 ~ 1 (Li) = L 2 . In the first case, L\ is a common eigenspace for 
the group. The second case implies L\ = L 2 which is absurd. In summary, we have shown that 
the group is reducible which contradicts the assumption. 

To prove (b), suppose otherwise that the restrictions of p to all level-0 subsurfaces having b 
as a boundary component are reducible. Let us choose a set of generators x±, x 2 , xs for 7Ti(Eo,4) 
as in §3.2 so that x\ corresponds to b. Let p(xi) be the matrix Ai in SL(2,K). Then by the 
assumption A(A U A 2 ) = A(A ll A 3 ) = A(A ll A 1 A 2 A 3 ) = 0. Since p(b) ^ ±id, the matrix A x 
has at most two eigenspaces. If it has exactly one eigenspace, then A{A\, A 2 ) = A(Ai, A 3 ) = 
implies that the eigenspace is invariant under both A 2 and A 3 . This contradicts the irreducible 
assumption. If A\ has two distinct eigenspaces L 2 and L 3 so that Ai(Li) = Li for i = 2, 3, then 
due to A(Ai, AiA 2 A 3 ) = 0, one of Li is invariant under AiA 2 A 3 . But this again implies that 
Li is a common eigenspace of Ai, A 2 and A 3 . 

To prove (c), we first note that the result holds for n = 3 by part (a). For n > 3, take 
generators x±, £ n -i for the free group 7Ti(Eo, n ) so that the boundary components are freely 
homotopic to Xi or x\...x n -\ as in figure 2.1. Now each 3-generator subgroup < Xi,Xj,Xk > lies 
in a level-1 subsurface subgroup. Thus the restriction of the representation to the 3-generator 
subgroup is reducible. By corollary 2.5(b), this shows that the representation is reducible. 

To see part (d), we may assume that / is the character of a diagonalizable representation p. 
Choose a set of generators {xi, x 2 , x 3 } for the fundamental group so that 7 and 7' are represented 
by x\x 3 and xiX2X 3 X2~ l as in fig. 3.3. Then ^(7) = trp{x\Xs) = trp(xix 2 xsx 2 ~ 1 ) = f(Y)- D 

3.6. In this section, we give a different interpretation of the triangles and quadrilaterals in 
the set S(E). This new interpretation is the basis for us in dealing with simple loops in the rest 
of the paper. 

We begin by introducing some notations. Recall that surfaces are oriented. If a and b are 
two arcs intersecting transversely at a point p, then the resolution of a U b at p from a to b is 
defined as follows. Fix any orientation on a and use the orientation on the surface to determine 
an orientation on b. Then resolve the intersection according to the orientations (see fig. 3.4). 
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The resolution is evidently independent of the choice of the orientations on a. If a _L (3 or 
a ±o take a G a, b G (3 so that |a fl b\ = I(a,/3). Then the curve obtained by resolving all 
intersection points in a fl b from a to b is again a simple loop denoted by ab. We define a/3 to be 
the isotopy class of ab. It follows from the definition that when a _L (3 then a/3 1 a,/5 and when 
a ±o /3 then a/? J_o a,/3. In particular, if E has level-1, then the positively oriented triangles 
in 5"(E) are (a,a/3,/3) where a _L /3 or ao -L Also the quadrilaterals are (a, /3, a/3; (3a). Let 
iV(a) and N(b) be two small regular neighborhoods of a and 6. Then N(a Ub) = N(a) U N(b) 
is homeomorphic to Ei ; i when a _L /3 and to Eo,4 when a J_o We use <9(a, /3) to denote the 
set of isotopy classes of the curves in ON (a U b). 



b 



ab ba 
Resolution from a to b Resolution from b to a 
Right-hand orientation on the front faces 
Figure 3.4 

In terms of these notations, the equations (b) in propositions 3.4 and 3.5 say that if a _L /3, 
then /(a/3) is determined by /(a), f{(3) and /(/3a), and if a J_o P, then /(a/3) is determined by 
the values of / on {a, /?, /3a} and <9(a,/3). More precisely, a function / : S(E) — > if is a trace 
function if and only if it satisfies: 

(1) /(a/3) + /(/3a) = /(a)/(/3), for a JL /3, 

(2) / 2 (a) + / 2 (/3) + / 2 (a/3) - /(a)/(/3)/(a/3) = /(«9(a, (3)) + 2 for a JL /3, 

(3) /2(c0 + / 2 (/3) + / 2 (a/3)+/(a)/(/3^ 

/(7s)/(74)) -/(/*)(/(7i)/(73) + /(72)/(74)) -/(«/3)(/( 7 i)/(74) + fMfM) -4 = 0, for 
a ±o /3, <9(a,/3) = {71, ...,74} so that (0,71,72) and (/3, 71,73) bound level-0 subsurfaces, 

(4) /(a/3) + /(/3a) = -/(a)/(/3) + /(7i)/(74) + f{l2)f{lz) under the same assumption as 
in (3). 

3.7. One of the main reduction lemma for simple loops is the following which generalizes 
Lickorish's lemma 2 in [Lil]. See [Lu2] lemma 7 for a proof. 

Lemma. Suppose 71,..., 7 m are pairwise disjoint classes in S'(E). If a G S'(E) intersects 
71 and is not _L or ±0 related to 71, i/ien a = /?i/?2 ™^ /3i J- /32 or /3i ±0 /?2 so that 

(1) /(A, 7i) < /(a, 71), J(A,7j) < ^(a,7j), W,7i) < A«,7i) «^ iWulj) < 
/(a, 7j) /or aZZ z = 1, 2 and j = 2, m, and, 
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(2) if Pi J-o ft, then for each element 5 G <9(ft,ft), -^(^7i) < I( a i1i) an d 1(5, ^j) < 
f° r J = 2 , ■■■,n f i. 

The lemma says that one can "simplify" a unless a fl 71 = 0, or a _L 7x, or a _L 7i- I n 
particular, if we set £0 = £ ^(^)l f° r each i, either aH^i = 0, or a _L 7^, or ct _L 7i}? then by 
induction on (/(a, 71), I(a, 7 m )), we have S'(S) = W^L Q n where Q n +i = Q n U {ct| a = ftft 
either (1) A J_ ft and {ft, ft, ftft} C S n or (2) ft J_ #2 and {ft, ft, ftft} U <9(ft, ft) C OJ- 

By the remark in the last two paragraphs in §3.6, we obtain, 

Corollary, (a,) Let 71, 7 m 6e pairwise disjoint classes in S(E) and f and g be two trace 
functions on S(E). If f(a) = g(a) for each class a G S(E) so that for each i either a fl 7$ = 0, 
or a _L 7^ or a ±0 7i? ^en f = g. 

(b) Let 71 anrf 72 are two disjoint classes in S'(Y) so that 71 bounds a £^1 anrf 72 /zes 
m If f and g are two trace functions on S(E) so that f(a) = g(a) for all a _L 72 and 

a _L 71, i/ien / = 0. 

Indeed, in part (b), if a J_o 7i, then a _L 72 cannot occur. Thus part (b) follows from part 

(a). 

3.8. As a second consequence of the above lemma, we obtain the following result which will 
be used in §6. Part (a) of the corollary was known to many people [Li2]. 

Corollary, (a) Given two non- separating classes a and a' , there exists a sequence of non- 
separating classes {ojj|z = 1, ...,m} starting from a and ending at a' so that _L for all 
i. 

(b) Given two essential 1 -holed tori (resp. level- 1 surfaces) T and T' in E, there exists a 
sequence of essential 1-holed tori (resp. level- 1 surfaces) {Ti } starting from T and ending at T' 
so that S'(Ti)nS'(T i+1 ) ^0 for alii. 

Proof. Let us denote two classes a and a' satisfying the conclusion of (a) by a ~ a'. We 
use the induction on I(a, a') to prove part (a). Clearly if a fl a' = or a _L a', then a ~ a'. 
If a J_o a ' \ since both a and a' are non-separating, one of the element P G d(a, a') is non- 
separating. Thus a ~ P ~ a'. In the remaining cases, by lemma 3.7, we can write a = P1P2 
where either Pi _L p 2 or Pi _L p 2 and I(Pi,a!) < I(Pi,a), i = 1,2. Since a is non-separating, 
one of ft or ft, say ft, is again non-separating. Thus by the induction hypothesis, ft ~ a'. 
But ft _L a or ft _L a. Thus a ~ a'. 

To see part (b), take a G S'(T) and a' G S'(T'). Let 2\ = T, T m+i = T' and T, be 
the 1-holed torus containing both ojj and c^+i. Then the result follows. The result for level-1 
surfaces T and T' is simpler. We omit the proof. 

3.9. It is shown in section 3 of [Lul] that there exists a finite set Fq G S(E) so that 
S(E) = U%L F n where F n+1 =F n U{a\a = ftft either (1) ft JL ft and {ft, ft, ftft} C F n or 
(2) ft _L ^2 and {ft, ft, ftft} U <9(ft, ft) C -F n }. In particular, if / is a trace function defined 
on S'(E), then / is algebraically determined by f\p. This shows the following result analogous 
to proposition 2.2. 
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Propositoin. There exists a finite set of isotopy classes of simple loops in each compact 
orientable surface £ so that SL(2, K) characters and trace functions on S(H) are algebraically 
determined by the restrictions of the characters on the finite set. 

§4. SL{2, K) Characters on the 5-holed Sphere 

4.1. We shall use the following terminologies. If / is a trace function on S(E) and £' is 
a subsurface of £, then we call /|s(£') the restriction of / to the subsurface £'. If f\s(z') is 
irreducible, we say £' is an irreducible subsurface with respect to /. We say a subsurface £' is 
bounded by cti, au G S"(£) if <9£' = ai U ... U ajt U b\ U ... U 6 m so that ai G ajj and bj C <9£. 

The goal of this section is to prove the following case of theorem 1.2 for the 5-holed sphere. 

Theorem. Suppose K is a quadratically closed field. If f is a K-valued trace function on 
£(£0,5) so that either f is reducible on all level- subsurfaces or f is irreducible on a level- 
subsurface bounded by two disjoint elements in £"(£0,5), then f is an SL(2,K) character. 

In §5.2, we prove that if / is a trace function on £(£0,5) which does not satisfy the conditions 
in the above theorem, then / is exceptional. 

4.2. The Pentagon Relations 

Given five pairwise distinct elements «i, 05 in £"(£0,5) so that ojj fl aj = for % 7^ j ± 1 
mod 5, it is shown in [Lu3] that 0^ J_o for all indices % mod 5 (see fig. 4.1). We say {a±, 
015} forms a pentagon in this case. If {a±,..., a$} forms a pentagon, then the following conditions 
hold. 

(a) (aiaj)ak = ai(ajak)- 

(b) aia i+1 a i+ 2 = a i+3 a i+ 4. 

(c) (aiOtj) n (ojjOjfc) = and (0,0^) n (a k ai) = 0, i ^ j ^ k ^ i. 

(d) ctiCtjCtk = ctjCtiCtk and akoijai = ctkOtiaj, if i 7^ j ± 1 mod 5. 

(e) ct^ctjcti = ctj if z = j ± 1 mod 5. 

These can be verified easily using the definition of resolution or see [Lu2] or [Lu3] for a 
proof. Note that, by (c), if {oji, «2, «3, 04, 015} forms a pentagon, then {aia^Q^ctsQ^a^a^} is 
also a pentagon (see fig. 4.1). 

4.3. In this section, we prove that if / is a trace function which is irreducible on a 3-holed 
sphere bounded by two elements 02 and 05 in £"(£0,5), then / is a character. 

Let X and Y be the level-1 subsurfaces bounded by «2 and as respectively. By proposition 
3.5, we find two representations px and py of iri(X) and iri(Y) respectively so that \ Px = f\s(x) 
and Xp Y = f\s(Y)- The restrictions of px and py to tti(X fl Y) have the same character 
by the construction and both are irreducible. Thus by lemma 2.4, these two restrictions are 
conjugate. After conjugate px, we may assume that px\m(xnY) = Py\tv 1 (xciY)- This defines a 
representation p : 7Ti(£ 0j 5) — > SL(2,K) so that its restrictions to tti(X) and tti(Y) are px and 
py respectively. Let g be the character of p. Then /(a) = g(a) for all oj G S(X) U 5(y). The 
goal is to show that f = g using the irreducibility condition. 
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By corollary 3.7 applied to / and g, it suffices to prove that for each ol\ so that cti-Lo a 2 
and ol\ ±o a 5, we have f(a\) = g(o\). To this end, we extend {a\, a 2 , a$} to a set {cki, 
015} forming a pentagon by setting as = 8(a\, 0:5) D £"(£0,5) and 0:4 = <9(cti, 0^2) H S"(So,5)- We 
shall use proposition 3.5 to derive a system of linear equations and show that the system has a 
unique solution and that both f(a±) and g(a±) are solutions. 

We begin by introducing some notations. Let h be a trace function defined on £(£0,5)- 
Given a set of indices = 1,2,3, let a^...^ = h(ai 1 ...ai k ) when a^.-.a^ is not in 

S'(X) U S(Y) and let a ix ____ ik = hfa^.-.a^) when a^.-.a^ G S'(X) U S(Y). Let $ be the 
component of <9£o,5 so that {ct!j_i, ctj+i} bounds a 3-holed sphere (indices mod 5) and let 
bi = h(Pi) (see fig. 4.1). Let r be the orientation preserving involution of £0,5 s ° that r sends 
ai+i to and to 

Now we derive equations for x^, a^- and with coefficient in /i(ct)'s where a G S'(X)U5 , (F) 
using proposition 3.5. 




The right-hand orientation on the front face 
Figure 4. 1 

Since 0:3 J_o a 4 an d 8(013,014) fl S"(£o,5) = a i, by proposition 3.5 (b), we obtain 
h(a 3 a 4 ) + h(a4as) = —h(as)h(a4) + h(a\)h(f3\) + h(/3 2 )h(/3 5 ). 
This is the same as, 

(1) X34 + X43-61X1 = p 1 . 

Here and below, pi always denotes some polynomial with integer coefficient in /i(ct)'s where 
a G S(X) U S(Y). 

Since a\ J_o «2 with 9(ai,«2) H 5"(Eo,5) = ct4 G ^(X), we obtain, 

(2) X12 + x 2 i + a 2 xi = p 2 . 
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Apply the involution r to the equation (2), we obtain 

(3) xi 5 + x 5 i + a 5 xi = p 3 . 

Since ct2 J-o «3«4 5 a2(a3«4) = a^a± and <9(«2, ot 3 a^) n5"(Eo,5) = a^a^ G S(X), we obtain, 

(4) X51 + X342 + 02X34 = P4- 

Since CI4 J_o «3«2? «4(ct3Ct2) = cnct5, ol-^^ol^ = olj,ol^(X2 and <9(ct4, ct^a^) n S"(So,5) = ttiQ;2, 
we obtain, 

(5) X15 + £342 - &1Z12 = P5- 

Subtracting (4) by (5), we obtain, 

(6) X51 - X15 + a 2 X 34 + 61X12 = £» 6 - 

Apply the involution r to equation (6) , we obtain, 

(7) X21 - £12 + a 5 X 4 3 + 61X15 = £>7- 

Since ai«2 J-o «5, «5(«i«2) = a3«4 and <9(ctict2, 0:5) H <S"(Eo,5) = a3Ct2 £ we obtain, 

(8) £34 + X125 + 05^12 =P8- 

Apply the involution r to (8) and use the fact that £125 = X152 (due to §4. 1(d)), we obtain, 

(9) £43 + £125 + 02X15 = Po- 
Subtracting (8) by (9) gives, 
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(10) 



^34 - X 4 3 - ^2^15 + ^5^12 = PlO- 



Now consider the system of linear equations (1), (2), (3), (6), (7), and (10). By (1), (2) 
and (3), we obtain x 2 \ = —a 2 x\ — x\ 2 + P2, £51 = —05X1 — £15 + P3 and X43 = b\X\ — X34 + pi- 
Thus, after substituting these into (6), (7) and (10), we obtain the following system of linear 
equations. 

61X12 - 2x i5 + a 2 x 34 - a 5 x x = p u 

(11) -2xi 2 + 61X15 - a 5 x 34 + (a 5 6i - a 2 )x 1 = p 12 

a 5 xi2 - a 2 xi 5 + 2x 34 - hxi = P13. 

Let A be the 3x4 coefficient matrix of the linear system and B be the 3x3 submatrix 
obtained from A by removing the 4-th column. Then the determinant of B is 2A where A = 
a 2 + ag + 6f — 020561 — 4. Suppose B* is the adjoint matrix of B. Then a simple calculation 
shows that B*A is 

/2A a 2 A \ 

2A a 5 A 
\ 2A -61A / 

Assume now that h is irreducible on the 3- holed sphere bounded by a 2 and 015, i.e., A ^ 0. 
Then we obtain a simpler system of linear equations satisfied by X12, X15, £34 and x\. 

2x 12 + a 2 xi = P14 

(12) 2x i5 + a 5 x x = P15 

2x 34 - 61X1 = pi 6 . 

By equations (1), (2), (3) and (12), we obtain 

2x 2 i + a 2 xx = p 17 

(13) 2x51 + a 5 xi = pi 8 

2x43 - 61X1 = pi 9 . 

On the other hand, there are many different extensions of {a 2 , a^} to a set forming a pentagon. 
For instance, {a[, a 2 , a' 3 , a' 4 , 0:5} ={aia 2 , a 2 , aj,a 2 , 0:4, 0:5} is such an extension. For this ex- 
tension, the same equations (12) and (13) hold. Here we have x' 21 = h(a 2 a[) — h(a 2 aia 2 ) = 
h{a\) = xi, x 51 = h(a5a[) — h(a^,aia 2 ) = /i(a3«4) = X34 and x[ = h(ai) = x\ 2 . By (13) for 
the new pentagon, we obtain 
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(14) 



2xi + a 2 x 12 = P20 
2x 34 + a 5 x 12 =P2i- 



Comparing (14) with (12), we obtain 



(15) (4-a!)xi = p 22 , 

and 



(16) (26i - a 2 a 5 )xi = p 23 . 

Apply the involution r to (15), we obtain 



(17) (4-a§)xi =p 24 . 

Since a| + a§ + 6f — 020561 — 4 7^ 0, if the characteristic of the field K is not 2, then one of 
the coefficients 4 — a 2 , 4 — a| and 2&i — 0205 is not zero. Thus we can solve xi uniquely from 
(15)-(17). If the characteristic of the field K is 2, then one of the coefficients a 2 , as or b\ is not 
zero. Thus we can solve x\ uniquely from (12). 

Now take h = f and h = g respectively. The condition f\s(x)uS(Y) = g\s(x)uS(Y) shows 
that x\ = f{a\) and x\ = g{a\) are the solutions of the same equations (1) -(17). Since 
both / and g are irreducible on the 3- holed sphere bounded by a 2 and 0:5, we conclude that 
/(cki) = o(«i). Thus by corollary 3.7, / = g follows in this case. 

4.4. In this section, we prove that if / is a trace function which is reducible on each level-0 
subsurface, then / is the character of a reducible representation. 

We choose a 3-holed sphere decomposition of £0,5 by a 2 and as as follows. If there exists 
a G 5"(Eo,5) so that f 2 (a) 7^ 4 then choose a 2 to be one of these elements. If otherwise that 
f 2 (a) = 4 for all a G S"(£o,5), choose a 2 and «s to be any pair of disjoint elements. We shall 
use the same notations introduced in §4.3. Thus X and Y are level-1 subsurfaces bounded by 
a 2 and cts respectively so that X n Y is a level-0 subsurface. By proposition 3.5, we find two 
representations px and py of iri(X) and tti(Y) respectively so that their characters are the 
restrictions of / to S(X) and S(Y). By the reducibility criterion lemma 2.5, both px and py 
are reducible. Thus we may modify px and py without changing their characters so that both 
px(^i(X HY)) and py (tti(X C\Y)) consist of diagonal matrices. Now since both px\m{xr\Y) and 
Py\-k 1 (xciY) are diagonalizable and have the same character, thus they are conjugate. We may 
assume after a conjugation that px\-K 1 (xnY) = PY\-K 1 (xnY)- By the same argment as in §4.3, we 
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construct a diagonalizable representation p of 7Ti(£o,5) to SL(2, K) extending both px and py. 
Let g be the character of p defined on S(T> Qj5 ). By the construction f\s(x)uS(Y) = g\s(x)uS(Y)- 
The goal is to show that / = g under the reducible condition. 

Since / is reducible on all level-0 subsurfaces, by corollary 2.5, / is reducible on all level-1 
subsurfaces. In particular, by corollary 3.5(d), f(a/3) = f(/3a) for all a _L ft- 

We now set up the same system of linear equations in x^...^, 1 < k < 3 as in §4.3. Then 
equations (1) - (10) still hold. Due to the reducibility, xi 2 = x 2 i, £15 = x$\ and £34 = £43. Thus 
equations (12)-(17) still hold. (Indeed, equation (12) is a consequence of (1) and X12 = #21-) 

Now if there is a G S"(E ,5) so that f 2 (a) 7^ 4, then 4 — f 2 (a 2 ) 7^ by the choice of a 2 . 
Thus we can solve x\ uniquely from (15). In particular, by the same argument as in §4.3, we 
obtain f{ct\) = g(ai). 

In the remaining case, f 2 (ce) = 4 for all a G 5"(Eo,5). First we note that corollary 3.3(a) 
implies f 2 ([3) = 4 for all boundary component (3 in £(£0,5) . For each boundary component 
P, f(/3) = g(/3) by the construction. We claim that that f(a) = g(a) for all a G 5"(E ,5)- 
Indeed, for each a G S"(E ,5), there exists two boundary components f3i and /3 2 so that @i, fa 
and a bound a level-0 subsurface. By the reducibility of / and g over the level-0 subsurface and 
corollary 3.3(a), we conclude that f(a) = /(/9i)/(/?2)/2 = g(/3i)g(/32) /2 = g(ct). (Here we have 
used the convention that if the characteristic of K is 2, then ab/2 is meant to be b when a = 2). 

4.5. As a consequence of theorem 4.1, we have, 

Corollary. Let f be a trace function defined on S(Eo jn ). Suppose Eo, n is decomposed as a 
union Xi U X 2 of two incompressible subsurfaces Xi and X 2 where Xi n X 2 = E 0; 3 is bounded 
by two elements in 5"(E). If f\s(Xi) is an SL(2,K) character for i = 1,2 and either f\s(x 1 nx 2 ) 
is irreducible or f is reducible on all level-0 subsurfaces, then f is an SL{2, K) character. 

Proof. Let pi be an SL(2,K) representation whose character is f\s(x i ) J i = 1,2. If / is 
reducible on all level-0 subsurfaces, then by corollary 3.5(c), both pi and p 2 are reducible. In this 
case, we may assume without changing the characters that both pi and p 2 are diagonalizable. 
Now by the same arguments as in §4.3 and §4.4, we produce a representation p of 7ri(Eo, n ) so 
that its restriction to 7Ci(Xi) is conjugate to pi. Let g be the character of p and f3\ and j3 2 be 
two classes in 5"(E 0)TJ ,) which bound Xi n X 2 . Then / and g are identical on S(Xi) U S(X 2 ) 
={a G ^(Eo,™)! at is disjoint from either (3i or (3 2 }. To show / = g, by corollary 3.7, it suffices 
to prove f(a) = g(a) for a J_o A, z = 1,2. Fix such a class a. Let E' be the incompressible 
level-2 subsurface which contains X\ n X 2 and a. Then by the proof of theorem 4.1 for E' with 
respect to the decomposition E' = (E'nXi) U (E'nX 2 ), we have = fi'ls(E')- I n particular, 

f(a)=g(a). □ 

§5. Exceptional trace functions on Planar Surfaces 

5.1. Recall that a trace function which is not the character of any representation is called 
exceptional. There are no exceptional trace functions on level-0 and level-1 surfaces. However, 
there exist finitely many exceptional trace functions on Eo, n for any n > 5. The main result of 
the section is to identify all exceptional trace functions. 
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Theorem. Suppose f : «S(£o,n) ~^ K, n > 5, is an exceptional trace function. Then the 
characteristic of K is not 2 and f satisfies, 

(a) f(S(2 , n )) = {2,-2} and, 

(b) there exists an exceptional lev el- 2 subsurface in £o,n- 

The proof of the theorem is by induction on n. In §5.2 we prove it for n = 5 and in §5.3, 
we prove it for all n > 6. 

We shall use the following notations. If oi, ...,o m are disjoint classes in S"(£ 5 , n ) so that 
they decompose the surface into subsurfaces £ 5l , ni and (gi, n\) ^ (gi, rii) for i > 2, then we use 
£ gi , ni (oi, ...,a m ) to denote the subsurface £ gi , ni . A class a G S"(£) is a boundary class if it 
bounds a level-0 subsurface. 

5.2. We prove a slightly stronger version of theorem 5.1 for n = 5 in this section. 

Let b±, 65 be the boundary components of So, 5. 

Proposition. If f : £(£0,5) ^ K is an exceptional trace function, then 

(a) the characteristic of K is not 2, 

(b) /(S(£ ,5)) = {2, -2} and nf =1 /(&0 = 32, and, 

(cj a level-0 subsurface is irreducible if and only if it is of the form £0,3(0:) for some 

Proof By theorem 4.1, we see that £0,3(0, j3) is reducible for all disjoint a, (3 e £"(£0,5) 
and there exists one irreducible £0,3(7). 

Lemma. Suppose 011,014 are two disjoint elements in £'(£0,5) 50 ^0,3(^1) ^rre- 
ducible. Then / 2 («i) = / 2 («4) = f 2 (bi) = 4 and £0,3(04) is again irreducible. Furthermore, 
the characteristic of K is not 2. 

Proof. Since £0,3(01) C £0,4(04) and £0,3(01) is irreducible, we see that £0,4(04) is irre- 
ducible. By corollary 3.5(a) applied to 01 in £0,4(04) and by the assumption that £0,3(0, 04) is 
reducible, there exists 02 J-o cxi in £0,4(0:4) so that £0,3(02) is irreducible. Extend {01,02,04} 
to a pentagon set {01,02,03,04,05} so that Oj ±0 where indices are counted mod 5. 

For i = 3,4,5, £0,4(0^) is irreducible since it contains one of £0,3(0*,), j = 1 or 2. By corol- 
lary 3.5(b) applied to Oj in £0,4(0^) and by the assumption that £0,3(0^,/?) is reducible, it 
follows that f 2 {oLi) = 4 for i = 3, 4, 5. Let the boundary components of £ ,5 be so labelled that 
(oj_i, bi, oji+i) bounds a 3-holed sphere. For each i = 1, 2, 5, £0,3(0^-1, Oj+i) is reducible and 
one of / 2 (oi_i) or f 2 (a i+ i) is 4. By corollary 3.3(a), it follows that = /(oi_i)/(o i+ i)/2 
(here ao/2 is meant to be 6 if the characteristic of K is 2 and a = 2). In particular / 2 (6 4 ) = 4. 
The values of / on <9£ , 3 (ai) are {f(a 1 )J(b 3 )J(b 4 )} = {f(a 1 ),f(a 2 )f(a 4 )/2,f(a s )f(a 5 )/2} 
whose multiplication is |llf =1 /(oi). For % = 3,4,5, the values of / on ^£0,3(0^) are {/(o^), 
f(bi+2), f(bi +3 )} = {/(oi),/(oi_i)/(o i+ i)/2,/(oi + 2)/(oj +3 )/2} whose multiplication is again 
^nf =1 /(oj). Since £0,3(01) is irreducible and f 2 (p4) = / 2 (o;) = 4 for z = 3,4,5, by corollary 
3.3(a), it follows that £0,3(0^) is irreducible. 

Now by the same argument above applied to {03, 04} instead of {01, 02}, we conclude that 
/ 2 (oi) = f 2 (oL2) = 4. Thus f 2 (bi) = 4 for all i. In particular, this implies that the characteristic 
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of K is not 2. Indeed, if otherwise, then all /(oj) = f(bi) = 0. Thus £ ,3(«i) would be reducible. 

□ 



To finish the proof of the proposition, take oi G S"(Eo,5) so that Eo, 3(0:1) is irreducible. 
Given any a G 5"(E ,5), by a result of Harvey [Hav] (see also [Har]), there exists a sequence of 
elements f3\ = 01, P2, Pm = o in £'(£0,5) so that Pi fl Pi + i = 0. By the lemma applied to the 
sequence, we conclude that / 2 (o) = 4 and E ,3(o) is irreducible. 



Suppose o G £"(£0,5) so that 6j and bj are in the boundary of E 0) 3(a). Then by corollary 
3.3(a), f(a) = —\f{bi)f{bj). This shows that / is determined by /|aE . 5 - Furthermore, take two 
disjoint a, a' in S"(Eo 5) so that b\ C <9Eo 3(0, a'). Then due to the reducibility and corollary 
3.3(a), /(6i)/(a)/(a')'= §• But also f(a)f(a') = \f \b 2 ) f (b 3 ) f (b 4 ) f '(6 5 ) . Thus nf =1 /(6,) = 32. 
□ 



5.3. We use the induction on n to prove theorem 5.1. Assume that n > 6. The proof 
consists of several steps. 

Let / be an exceptional trace function on 5 , (E , n ). 

Claim 1. There exists an exceptional subsurface E 0in -i(/3) in E 0)n . 

By corollary 4.5, there exists an irreducible level-0 subsurface E' in E , n - Now E' is either 
Eo, 3(01, "2), or E ,3(ai), or £0,3(01, a 2 , a 3 ) for disjoint classes oi,..,a 3 in 5"(£ , n )- If E' = 
Eo, 3(01, 02), by corollary 4.5, one of the subsurface bounded by a.\ or a 2 is exceptional. Take 
any E , n -i(/3) which contains this exceptional subsurface, then the claim follows. 

If £' = E ,3(ai), we use the following lemma. 

Lemma. // Eo,3(o) is irreducible and Pi, j3 2 are two disjoint classes in 5"(Eo, n ) so that 
they bound a level- 1 subsurface which contains £0,3(0), then one of the subsurface bounded by 
Pi is exceptional. 
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(a) 



(b) 



Figure 5.1 

Indeed, by corollary 3.5(a), there exists 7 J_o o in £0,4 (/3i, P2) so that one of £0,3(7, A)? 
say £0,3(7, Pi), is irreducible. By corollary 4.5, one of the subsurface bounded by 7 or Pi is 
exceptional. But each subsurface bounded by 7 or Pi is contained in a subsurface bounded by 
Pi or /? 2 . Thus the lemma follows. 

If £' = £0,3(011, 02, 03), let £" be the irreducible subsurface bounded by 0:1,0:2 which 
contains £'. If £" is exceptional, then claim 1 follows. If the £" is a 4-holed sphere, then 
by corollary 3.5(a) applied to 03 in £", we find an irreducible £0,3(0^,0') where i = 1 or 
2. The claim follows by the previous argument. In the remaining case, the level of £" is at 
least 2 and f\s(E") is the character of a representation p of 7ri(£"). Since p is irreducible, 
there exists a boundary component 6 C <9£ , n H <9£" so that p(6) 7^ ±z<£ Consider a level-1 
subsurface of £" of the form £0,4(01,02,04) so that it contains £0,3(01,02,03) and contains 
b as a boundary component. By corollary 3.5(b) applied to this level-1 subsurface, we find an 
irreducible £0,3(0,0') having b as a boundary component. Thus the claim follows. 

Now by the induction hypothesis applied to £o, n -i(/3), it follows that £o, n contains an 
exceptional level-2 subsurface, i.e., part (b) of the theorem 5.1 follows. 

Claim 2. Let b\ and 62 be the boundary components o/£o n which are not in the exceptional 
£ ,n-i(/5). Then f 2 {b i )= A for i = 1,2. 

Indeed, if n > 7, for each 6j, there exists an (n — l)-holed sphere containing both bi and 
the exceptional level-2 subsurface in £ , n _i(/3). Thus by the induction hypothesis, we conclude 
that fihf = 4 for % = 1,2. 

If n = 6, we pick a boundary class (3' G S"(£o,6) so that £0,3 is in the exceptional 
£0,5 (/?) (see fig. 5.2). Let f3\ and $2 be two disjoint boundary classes so that fa D = and 
/5j ±0 /3- Since £0,5 (/?) is exceptional, £0,3 (/?') is irreducible. By the above lemma applied to 
o = ft', we conclude that one of £0,5 (A) > say £0,5 (/?i), is exceptional. Since bi C £0,5 (Pi), it 
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follows that f 2 (bi) = 4. Next we assert that T, ^(/3) is reducible. Assuming the assertion, by 
corollary 3.3(a), we conclude that f(b 2 ) = /(&i)/(/3)/2 = ±2. To see that £ ,3(/3) is reducible, 
we construct two disjoint boundary classes 71,72 in £q,6 which are in £q,5(/3). If T,q^(P) were 
irreducible, then by the above lemma applied to {/?, 71, 72}, we conclude that one of £0,5(71), say 
£0,5(71), is exceptional. Let 7 be a class disjoint from (3 and 71 and 7 _l_o 72- Then £0,3(^,7) 
is irreducible since it is in the exceptional £0,5 {(3). But £0,3 7) is also reducible since it is in 
the exceptional £0,5(71). This is a contradiction. 




Figure 5.2 

Claim 3. If a J_o P where £o, n -i(/3) is exceptional, then f(a) = ±2. 

Choose a class (3' G 5"(£o, n ) disjoint from (3 so that (3', a and one of bi or 62, say b±, 
bound a 3-holed sphere T, 0j3 (f3' , a) (see fig. 5.2(c)). By the induction hypothesis applied to 
£ , n -i(/3), we have f{(3') = ±2. If £ ,3(a,/3') is reducible, then by corollary 3.3(a), we obtain 
f(a) = f(/3')f(bi)/2 = ±2. If £0,3(0, (3') is irreducible, then by corollary 4.5, one of the 
subsurface X bounded by (3 1 or a which contains £0,3(0;, (3) is exceptional. Thus by the induction 
hypothesis applied to a subsurface containing X and a, f(a) = ±2. 

Claim 4. For all a E S"(£ , n ), /(«) = ±2. 

We use the induction on I(a,f3) to prove the claim. By claim 3, the result holds for 
I(a,(3) < 2. If I(a,f3) > 4, by lemma 3.7, we can express a = a' a" so that a' ±0 ck", 
d(a',a") =ftU ... U/3 4 satisfy /(a', /?), /(a", /?), I(a"a' , p), I(pi, p) < I{a,p). Thus by the 
induction hypothesis the values of / on the seven elements {«', a", a" a', Pi, $4} are in {2, —2}. 
Now the following lemma implies that f(a) = ±2. 

5.4. Lemma. Let <9£o,4 = 61 U 62 U 63 U 64 and ol\, and as be three classes forming a 
triangle in 5"(£o,4). If f '■ £(£0,4) ^ K is a character so that its values on the 7-element set 
{ai.bj} are {2,-2}. Then /(£(E ,4)) C {2,-2}. Furthermore, 

(a) 2II 4 3 =1 /(a i ) = n*^/^), 

f&j z/ it/ie characteristic of K is not 2, then f is reducible if and only if Hl- =1 f(bj) = 16. 
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(c) If g : — > {2, —2} satisfies 2Il^ =1 g(ai) = Hj =1 g(bj) = —16, then g can be extended 
to an SL(2,K) character on £(£0,4). 

Proof. Fix an orientation on each bi and consider it as an element in the fundamental group. 
Let p be a representation whose character is /. Changing p to p' by p'(bi) = ±p(bi), i = 1,2, 3, 
will not effect the conclusion of the lemma. Thus we may assume that f(b±) = /(&2) = /(&3) = 2. 
Now if /(&4) = 2, then proposition 3.5(a) shows that 8E? =1 /(ctj) — ILf =1 /(oi) = 40. Since 
f(ot.i) = ±2, the only solution of the equation is /(oj) = 2. By proposition 3.5(b), this implies 
that f(a) = 2 for all a. If /(6 4 ) = —2, then proposition 3.5(a) says that ILf =1 /(ctj) = —8. 
Furthermore, proposition 3.5(b) implies that f(a' 3 )+f (as) = — f {oi\) f (a.2) where (oi, «2, 03; a' 3 ) 
forms a quadrilateral. But f(as) = — \f(a.\)f(a.2). Thus f(a' 3 ) = f(a^) = ±2. By the modular 
configuration, this implies that /(S^Eq^)) C {2, —2}. The last argument also shows that for any 
assignments of ±2 to ctj's so that their product is —8, there exists an extension of the assignment 
to a character. Thus part (c) follows. □ 

The following figure 5.3 illustrates the set of all possible assignments of ±2 to the 7-element 
set {bi, aj} in the lemma. 




2 2 2 ai ai 



aia2a3 = -8 aia2a3 = -8 



Figure 5.3 

As a consequence of the theorem 5.1(b) and the fact that trace functions are determined by 
their values on a finite subset of S(E) (§3.9), we see that there are only finitely many exceptional 
trace functions on each planar surface. 

5.5. The goal of this section is to prove that exceptional trace functions exists on each 
planar surface of level at least 2. 

There are sixteen exceptional trace functions / on £9,5 which we describe as follows. Let 
d£ ,5 = bi U ... U b 5 . Suppose / : {61, ...,65} -> {2, -2} satisfies U 5 i=1 f(bi) = 32. We extend / 
to / : «S(£o,5) ~" *■ {2, —2} as follows. Given any boundary class a so that the level-0 subsurface 
^o, 3(d) contains bi, bj, then f(a) = —\f{bi)f{bj). Ones checks easily using lemma 5.4 that / is 
a trace function on 5 , (£o,s)- Furthermore, by the construction / is reducible on each £0,3(0^ P) 
and irreducible on each £0,3(0). There is no representation whose character is the trace function 
/. Indeed, if Xp = / f° r a representation p and a G S"(£o,5), then by corollary 3.5(b) applied to 
£0,4(0), we have p(a) = ±id. But this implies that p is reducible on £0,3(0) which contradicts 
the assumption. Thus these are the set of all 16 exceptional trace functions on £0,5. 
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If n > 6, we construct an exceptional trace function on E 0jn as follows. Let bi, b n be the 
boundary components of £o, n - Define / : «S(£o,n) — > {2, —2} as follows. Let = 2 for all z. 
For a G 5"(E 0)n ), we define f(ot) as follows. Suppose a decomposes E 0)n into two subsurfaces 
Xi and X2. Let Sj be the number of components of {61, ...,65} which are in Xi. Define f(oe) to 
be —2 if (si, S2) = (2,3) and to be 2 otherwise. By a simple calculation using lemma 5.4, one 
shows that / is a trace function and there exists an exceptional level-2 subsurface. Thus / is an 
exceptional trace function. 

§6. The Characterization Theorem for 1-holed Torus 

We show that each trace function on £(£^2) is a character in this section. 

6.1. The pentagon relation 

A five-element set {cti, ...,0:5} in ^"(Ei^) is said to form a pentagon if ctj n cti+2 = for 
all i mod 5. It is shown in [Lu3] that the set is unique up to homeomorphism of the surface 
and that exactly two adjacent elements on and ctij+i, say as and 014, are separating classes and 
«3 J_o «2 -L cti _L «5 J_o «4- See figure 6.1. 

If {«!, 015} forms a pentagon with I(ot3, 0:4) = 4, then we have, 

(a) (ctiCtj^ctjt = ai(ajak) where the indices k are pairwise distinct, 

(b) aiajCtk = ajOtiOtk if the indices are pairwise distinct and on fl ctj = 0, 

(c) a^o^cniQfs) = ct4Ct5ai, [ol20l\ol^)ol2 = «ict5, and ol20l\ol^ D cki = 0, 

(d) ai«2 H ai«5 = and oliol\ fl a^cti = 0, 

(e) aio^o^ fl cticts = and a^a^OL^ fl ai«5 = 0. 

See [Lu2] or [Lu3] for a verification. One can also verify (a)-(e) directly. For instance a\a^ 
and ai«2 are obtained by applying the positive Dehn twist along ol\ to a$ and «2- Thus (d) 
holds. 

By property (d), if {a±, ct2, «3, CI4, 015} forms a pentagon, then {cti, a 2 ai, ct3, ct4, a^cti} is 
also a pentagon. 

6.2. In this section, we prove the following, 

Proposition. If f is a trace function on £(£1,2) and there exist two disjoint elements 
oil, «4 in S'(T,i t 2) with separating so that f 2 (ai) 7^ /(ct^) + 2, then f is a character. 

Proof Let X and Y be the level-1 subsurfaces bounded by CI4 and cti respectively. 
Then X fl Y" is a level-0 subsurface bounded by «4,ai,ai. Since / 2 (cti) + f 2 (cti) + f (0:4) — 
/(ai)/(ai)/(a 4 ) - 4 = (/(a 4 ) - 2)(/(a 4 ) + 2 - / 2 («i)), / is reducible on X n Y" if and only 
if /(«4) = 2. We now construct a representation p of 7Ti(Ei j2 ) so that the restrictions of the 
character of p to X and Y are the same as f\s(x) and /|s(y) as follows. If f{a^) 7^ 2, due to 
the irreducibility of / on X fl Y, the construction is the same as in §4.3. If f{a^) = 2, then 
f{ a 2) 7^ ±2 by the assumption. By lemma 2.6, there are exactly two conjugation classes of 
SL{2, K) representations of H\(X) (respectively 7Ti(X fl Y)) whose characters are f\s(x) (resp. 
f\s(xnY))- Furthermore, due to /(CI2) 7^ ±2, the restriction of the non-diagonalizable represen- 
tation of 7Ti(X) to ixi(X fl Y) is still non-diagonalizable. Now take a representation py of 7Ti(Y) 
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whose character is f\s(Y)- Then there exists a representation px of tti(X) whose character is 
f\s(x) so that pxl^ixnY) = Py {^(xnY)- Let p be the representation of 7i"i(E) whose restric- 
tions to iii(X) and ^i(Y) are px and py and let g be its character. We have f{a) = g{a) for 
a G S'(X) U S(Y). The goal is to show that / = g. By corollary 3.7, it suffices to prove that for 
each class 0:5 _L ol\ and 0:5 _l_o «4, /(«s) = 9(^5). 

Extend {cti, 0:4, 0:5} to a 5-element set {cti, CK5} forming a pentagon. The proof of 
/(as) = ^(0:5) follows the same strategy as in §4.3 by introducing a system of linear equa- 
tions. 

We shall use the same notations as in §4.3. Let h be a trace function on £(£1,2) so that 
/i 2 (ai) 7^ ^(0:4) + 2. Given a set of indices zi,...,Zfc, 1 < < 3, let Xi lm ..i k = h(ai 1 ...ai k ) if 
CKj 1 ...o;i A , is not in S'(X) U S(Y) and a,i x ...i k = ^(aii---ct!£ fc ) if a^.-.a^ G S'(X) U S(Y). Let /?i and 
/?2 be the boundary components of £1,2 and 6j = h((3i). 

Using propositions 3.4 and 3.5, we now derive a system of linear equations in Xi lm ..i k and 
show that the system of equation has a unique solution. 

Since a± _L 0:5, by proposition 3.4(b), we obtain 

h{a\a^) + h{a^a\) — h(a\)h(a<~,) . 

This is the same as, 



(1) X 15 + X51 = CliX 5 . 

Since CK4 i_o «5 so that d{a^ 0:5) = {«2, ct2, /?2} 5 by proposition 3.5, we obtain, 



(2) X45 + ^54 = -^4^5 

where pi and the p^'s below are polynomials with integer coefficients in h(a)'s where a G 
S(X)\JS(Y). 

Since «2 -L ot^otxa^ so that (^(o^i^s) = ct^a^ai and (o^cticts)^ = ai«5 and o^ckicks G 
«S(y), we obtain, 



(3) ^451+^15=^2- 

Let r be the orientation reversing involution of E12 fixing each ctj's (see fig. 6.1). Then 

r{af3) = r{j3)r{a) for all a _L /3 or a i_o P- 
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The pentagon relation 



The orientation reversing involution^ 



Figure 6.1 



Apply t to (3), we obtain 



(4) 



^154 + %51 = P3- 



Since 0:4 _l_o ai«5 so that <9(a4, aicts) = aia2 G S(X), we obtain, 



(5) 



^415 + ^154 + a 4 Xi5 = P4. 



Since 0:4 fl cci = 0, 



(6) 



3^415 = Xl45- 



Finally, since ol\ _L CK4CK5, by (6) we obtain, 



(7) 



^145 + ^451 - aiX 45 = 0. 



Subtracting (7) by (5) and using (6), we obtain 



(8) 



£451 - £154 - aix 45 - a 4 a;i5 = p 5 . 



The subtraction (4) by (3) gives, 



(9) 



2154 - £451 + £51 - X15 = P6- 
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The sum of (8) and (9) gives 



(10) x 51 - x 15 - a x x A5 - a 4 x 15 = p 7 . 

Using (1), we simplify (10) and obtain 



(11) aix 4 5 + (2 + a 4 )xi 5 - ci!X 5 = p 8 . 

Since (11) holds for any 5-element set {a[, o 4 , a' 5 } forming a pentagon so that a[ = ol\ 
and o 4 = «4, it holds for the set {oi, «2«i, 03, 04, 0501} ={a[, a' 2 , a' 3 , o 4 , a' 5 }. Now h{a' 1 a' 5 ) = 
h (a 10:50:1) = ^(05) = X5, h(a' 5 ) = h(a$ai) = X51 = a\x§ — x±5 and h(a' 4 a' 5 ) = /i(o405«i) = 
X451 = — X15 +P2- Thus equation (11) for this new pentagon set gives, 

ai(-xi 5 + p 2 ) + (2 + a 4 )x 5 - a 1 (a 1 x 5 - x 15 ) = p 9 

which is 

(2 + a 4 - aj)x 5 = pg. 

Thus x$ can be solved uniquely. Now take h = f and h = g. We see that /(05) = #(05). 
By corollary 3.7, it follows that / = g. 

6.3. Suppose now that / is a trace function so that / 2 (oi) = /(04) + 2 for all separating 
04 and non-separating 01 with 01 fl 04 = 0. 

We begin with the following lemma. 

Lemma. Let E = E 5>n be a surface of level at least 2 so that g > 1 and f is a K -valued trace 
function on S(E). Let P(E) = {(a, (3) G S(E)\a bounds a E^i in E and 13 is a non- separating 
class lying in Si,i}. 

(a) If for all (a,f3) G P(E), f 2 (/3) = f(a)+2, then either for all (a,f3) G P(E), (/(a), /(/?)) 
= (-2, 0) or for all (a, (3) G P(E), (/(a), /(/?)) = (2, ±2). 

ffr,) if there exists a pair (a,/3) G P(E) so i/iai f 2 {f3) 7^ /(o) + 2, i/ien there exits a pair 
(a', 13') G P(E) so tfiat f 2 (/3') ^ f(a') + 2 and one of f 2 (a') or f 2 (/3') is not 4. 

Proof. To prove (a), fix o G 5"(E) which bounds a and let P a be the set of all non- 
separating classes (3 lying in E^i. Take three elements f3±, f3 2 and /?3 in P a forming a triangle 
in the modular configuration. Let f(a) + 2 be /U 2 . Then f 2 ((3i) = fj 2 . By proposition 3.4(a), 
we obtain 3fi 2 ± /U 3 = /U 2 . Thus either ,u = or y 2 = 4, i.e., either (/(a), /(/3)) = (—2, 0) for all 
(3 G P a or (/(a), /(/?)) = (2, ±2) for all /3 G P Q . 
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To finish the proof of (a), we need to show that the above two cases cannot occur simul- 
taneously. The above proof shows that being (/(a), /(/?)) = (2, ±2) or (—2, 0) depends only on 
the 1-holed torus bounded by a. Thus part (a) follows from corollary 3.8(b). 

To prove part (b), we may assume that the characteristic of the field K is not 2 (otherwise 
by part (a) the result follows). Now suppose otherwise that for all (a,/?) G -P(E) so that 
f(p) ^ f( a ) + 2, we have f 2 (a) = f 2 ((3) = 4. This implies that f(a) = -2. Consider the 
level- 1 subsurface E^i bounded by a which contains (3. Let /?2 and ftz be three classes in 
5"(Ei 5 i) which form a triangle in the modular configuration. Then for i = 2, 3, either f 2 (/3i) = 4 
(if f 2 {pi) ^ f(a) + 2) or fipi) = (if / 2 (&) = /(«) + 2). By proposition 3.4(a), we have 
/ 2 (/3) + / 2 (/3 2 ) + / 2 (/3 3 )-/(/3)/(/3 2 )/(/?3) =/(a) + 2. Thus 4 + / 2 (/3 2 ) + / 2 (/3 3 ) = ±2f(0 2 )f(0 3 ). 
But this is impossible since either f 2 (/3i) = 4 or for i = 2, 3. □ 

6.4. Let 9Ei 2 be b\ and 62. By proposition 6.2 and lemma 6.3, it remains to prove the 
following. 

Proposition. Suppose f is a K valued trace function on £(£1 2) so that either (a) for all 
{a, 13) G P(E 1)2 ) (/(a), /(/?)) = (-2,0) or ft) /or a// (a,/?) G P(e' 1)2 ) (/(a), /(/?)) = (2, ±2). 
TTien f is a character. 

6.5. We construct a representation whose character is / satisfying condition (a) in the 
proposition 6.4 in this section. 

Lemma. Let <9Ei 2 &e 61 U 62- Under the assumption of proposition 6.4(a), we have 
f 2 (b l )=4andf(b 1 )f(b 2 ) = -4. 

Proof. Take («i,/3i) G /-"(E^i) and let E 0) 4 and E11 be the subsurfaces bounded by (5\ 
and oji- Take P2 to be a non-separating class lying in Eo,4 so that P2 J-o ot\. Then cti/^ 
and /92«i are both non-separating. By the assumption, f(f3i) = fifocti) = /(cti/^) = and 
f(a) = —2. By proposition 3.5(a) applied to £0,4 with respect to the triangle (a±, (32, ccifo), 
we obtain f(bi) + f(b 2 ) = 0. By proposition 3.5(b) applied to E ,4 with respect to {a\ = 
foictifo), (ai/3 2 )/32} 5 we obtain f(bi)f(b 2 ) = —4. Thus the result follows. □ 

Here is a construction of a representation p : 7Ti(Ei )2 ) — > SL(2,K) whose character is /. 
For simplicity, let /(&i) = 2 and /(6 2 ) = —2. Let Ei 5 i be obtained by attaching a disc to 
the bi boundary component of the surface Ei 2- By corollary 3.4, there is a representation 
Po : 7Ti(Ei 5 i) — > SL(2, K) so that tr(po(a)) = for all a G 5"(Ei i) and tr(po(^)) = _ 2. Define 
p = Po o i where i : 7Ti(Ei 5 2) — > 7Ti(Ei 5 i) is the homomorphism induced by the inclusion map. 
Since i send non-separating classes to non-separating classes, it follows that the character of p 
is /. 

6.6. We construct a representation whose character is the trace function / satisfying con- 
dition (b) in the proposition 6.4. 

We may assume that the characteristic of the field K is not 2 in this section (otherwise it 
is covered by §6.5). 

Lemma. Under the assumption of proposition 6.4 (b), we have f(b±) = f(p2) = ±2. In 
particular, f is reducible over all level- subsurfaces. 
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Proof. Since f(a) = 2 for all separating classes o, / is reducible on all 1-holed tori. In 
particular, if a\ _L ct 2 , then by proposition 3.4(a), /(oio 2 ) = \j r («i) J '"(02) • Thus /(oio 2 ) = 
/(o 2 oi). On the other hand, if /3 and 7 are two non-separating classes so that (3 J_o 7? then there 
exists three non-separating classes b~\ _L 5 2 J- £3 so that /3 = 818283 and 7 = ^fo&i. (Indeed, the 
pair (/?, 7) is unique up to the homeomorphism of the surface). Thus we have f(/3) = fi'j)- 
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Figure 6.2 

Now take two classes oi _L o 2 . Since /(oi)/ (o 2 )/(oio 2 ) = 8, we may assume that /(01) = 
2. Let Eo,4 be the subsurface bounded by ol\ and let 03 J_o 04 be two non-separating classes 
lying in So, 4. Then both 0:5 = 03O4 and o 5 = 0403 are separating classes. By the observation 
above, 7(0:3) = /(04) and /(05) = /(o 5 ) = 2. By proposition 3.5(a) applied to the triangle 
(03,04,05) in So,4, we obtain f{b\) + /(^) = ±4. By proposition 3.5(b) applied to 05,05, we 
obtain /(6i)/(6 2 ) = 4. Thus f(bi) = f(b 2 ) = ±2. Since f(a) = 2 for all separating classes, 
this shows that / is reducible on all level-0 subsurface bounded by o. Thus / is reducible on all 
level-0 subsurfaces. □ 

We now construct a diagonalizable representation p of 7ri(Ei )2 ) whose character is / as 
follows. 

Take (o,/3) G P(Ei ;2 ) and let X and Y be the level- 1 subsurfaces bounded by o and (3 
respectively. By the same argument as in §6.2, we construct a diagonalizable SL(2, K) repre- 
sentation of 7Ti(£i )2 ) so that its character g equals / on S(X) U S(Y). To show that g = f, by 
corollary 3.7, it suffices to prove ^(7) = (7(7) for all 7 ±0 o and 7 _L (3. Let 5 be a class disjoint 
from a and 7. Then f(S) = g(S). By the reducibility of / and g on the level-0 subsurface 
bounded by 5, 7, it follows that /( 7 ) = |/(6i)/(<J) = ^(&i)</(<5) = 0(7)- □ 

§7. The Proof of Theorem 1.2 

The goal of this section is to prove theorem 1.2 for surfaces of positive genus by using the 
induction on the level of the surface. 

Let E = E g n be a surface of positive genus and / a K-valued trace function defined on 
S(E). Recall that -P(S) is defined to be {(o,/3) G 5 , (E 3 n ) x S(E gjn )\ a bounds a E^i and (3 
is a non-separating class lying in the subsurface E11}. The proof breaks into the following two 
cases: (a) there exists (o, (3) G P(E) so that f 2 (f3) ^ f(a) + 2, and (b) for all (o, (3) G P(E) 
f 2 (/3) — /(o) + 2. By lemma 6.3, case (b) is equivalent to two subcases (bl) for all (o, 0) G 
P(E), (f(a), f{(3)) = (-2,0) and (b2) for all (o,/3) G P(E), (/(a), f{(3)) = (2, ±2). 

We will deal with these three cases (a), (bl) and (b2) separately in the following sections. 
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7.1. Suppose the case (a) occurs. By lemma 6.3(b), we may assume that one of f 2 (a) 
or f 2 (P) is not 4. Let X be the level-1 subsurface bounded by a and let Y be the subsurface 
£ — int(N([3)). Since f\s(Y) takes some values other than ±2, by the induction hypothesis if 
g > 2 and by the result in §5 if g = 1, f\s(Y) is a character, say f\s(Y) = Xp y for an SL(2, K) 
representation py of tti(Y). Now if /(a) 7^ 2, then both /|s(x) and f\s(xr\Y) are irreducible. 
Let px : — > SL(2,K) be any representation whose character is /|s(x)- By lemma 2.4, 
we may assume after a conjugation that that px\m(xnY) = PiH-7ri(xny)- If /(oO = 2, then both 
f\s(x) and /|s(xny) are reducible. Since one of f 2 (a) or f 2 ((3) is not 4, by lemma 2.6, there exist 
exactly two SL(2, K) conjugacy classes of representations of tti(X) whose characters are f\stx)- 
Thus we may choose an SL(2, K) representation px of tti(X) so that pxl^xnY) = Py^^xccy) 
and x Px = f\s(x)- 

Define a representation p : 7Ti(E) — > SL(2, K) by p\ ni (x) = Px and pl^y) = py. Let g be 
the character of p. Then #|s(x)uS(y) = f\s(x)uS(Y)- 

To show that g = /, by corollary 3.7, it suffices to prove ^(7) = (7(7) for all 7 _L « and 
7 _L /?. Given such 7, consider the level-2 subsurface £1,2 containing both X and 7. Then by 
the proof of proposition 6.2 applied to £1,2 with respect to the decomposition X and Y n Ei 2 , 
it follows that (7(7) = /(7). 

7.2. To show the remaining cases, we need, 

Lemma. Suppose f is a trace function on E g>r so that the case (bl) or (b2) holds. Then 
f is reducible on all level- subsurfaces. 

Proof. Since each level-0 subsurface is contained in a 3-holed torus subsurface, it suffices to 
prove the lemma for the 3-holed torus E13. Each level-0 subsurface in E13 is either contained 
in a 2-holed torus subsurface or is bounded by a boundary class. By §6.5 and §6.6, those level-0 
subsurfaces contained in a 2-holed torus are reducible. It remains to show the reducibility of the 
level-0 subsurface £0,3(7) bounded by a boundary class 7 and two boundary components b\ and 
62 of £1,3. Take disjoint non-separating classes 71 and 72 so that 7^ fl 7 = for % = 1, 2 and take 
73 so that 73 fl 7i = for % = 1, 2 and 73 J_o 7- Note that 73, 737 and 773 are non-separating 
classes. 

In the case (bl), (f(a),f((3)) = (-2,0) for all (a, (3) G P(Ei, 3 ). By proposition 3.5(a) 
applied to the level-1 subsurface bounded by 71, 72 and the triangle (7,73,773), we obtain 
f 2 (h) + f 2 (b 2 ) + / 2 ( 7 ) - /(7)/(6i)/(6 2 ) -4 = 0. Thus by proposition 3.3, £0,3(7) is reducible. 

In the case (b2), we may assume that the characteristic of K is not 2 (otherwise the 
result is clear). Now both £0,3(73, 7i), i = 1,2 and £0,3(71,72,7) are reducible since they lie 
in some 2-holed torus subsurfaces. Thus, by corollary 3.3, f(bi) = \f{^^)fi^li), i = 1,2 and 
f(l) = \f(li)f('l2)- This implies that / '(61) / '(6 2 ) f (7) = 8. By corollary 3.3, this shows that 
£-0,3(7) is reducible. □ 

7.3. We now show that in the cases (bl) or (b2), the trace function / is a character. 

Take (a, (3) G -P(£) and let X be the £1,1 subsurface bounded by a and let Y be the 
subsurface bounded by f3. 

If (/(a), f((3)) = (2, ±2), then by lemma 7.2, we construct a diagonalizable representation 
p of 7Ti(£) so that its character g = Xp satisfies g\s(x)uS(Y) = f\s(x)uS(Y)- To show that / = g, 
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by corollary 3.7, it suffices to prove f(-f) = (7(7) for all 7 _L ol and 7 _L f3. Consider the level-2 
subsurface Ei 2 containing X and 7. Since both / and g are reducible on all level-0 subsurfaces, 
by the proof of proposition 6.2, it follows that 7(7) = (7(7). 

If (/(«),/(/?)) = (2,0) and the characteristic of K is not 2, we note that the genus g of 
E ff n must be 1. Indeed, if g > 2, then there exists essential subsurface E12 whose boundary 
components « = 1,2 are non-separating simple loops in E ff n . By the assumption f(f3i) = 0. 
But by lemma 6.5 applied to £1,2, we have /(A) = ±2 which is a contradiction. 

We now construct a representation as follows. Let <9£i, n be b\, b n and let i : 7Ti(£i ;n ) — > 
7ri(Ei 5 i) be the homomorphism induced by the inclusion map j : £i ;n — > Ei ; i so that j(b n ) = 
<9£i,i. Let p' : E 1;1 — > SL(2,K) be a representation so that x p '(a) = for all non-separating 
class a and x P '(<9£i 5 i) = —2 (see corollary 3.4). Let po = p' o i be a representation of 
7i"i(Ei )n ). The fundamental group 7Ti(E 1>n ) is a free group on (n + 1) generators 
where xi, x n _i correspond to the boundary components bi, 6 n _i. Now modify po to pro- 
duce a new representation p of 7ri(Ei jn ) by redefining p(xi) = ±po(xi) so that Xp( x i) = f(bi) 
for i = 1,2, ...,n — 1. Let g be the character of p defined on S^Ei^). Then g satisfies 
{g{a), g{j3)) = (—2,0) for all (a,/3) G P(Ei jn ) (indeed each non-separating loop in Ei >n be- 
comes a non-separating loop in E^i). Furthermore, by lemma 7.2, the character g is reducible 
over all level-0 subsurfaces. We prove that / = g by induction on n. The result follows for 
n = 1,2. We first claim that /(6 n ) = g(b n ). To see this, take a boundary class a' so that 
£0,3(0;') contains b n and 6 n _i. By the induction hypothesis applied to the subsurface £i iTJ ,_i 
bounded by a', we conclude that f(a') = g(ce'). By the reducibility of / and g on E 0; 3(a') and 
f(b n -i) = g(b n -i), it follows that f(b n ) = g(b n ). Now for any separating 7, let £' be the planar 
subsurface bounded by £' in £i jTJ ,. Since / and g are both reducible on all level-0 subsurfaces, / 
and g are reducible on £'. Furthermore, / and g have the same values on all but one boundary 
component 7 of Thus, by the reducibility, f{^) = (7(7). □ 

§8. Proof of Theorem 1.1 

We begin with the following special case of theorem 1.1. 

8.1. Proposition. Suppose K is a quadratically closed field and f : G — > K is a K- 

trace function defined on a finitely generated group G. Then f is the character of an SL(2, K) 
representation of the group. 

Proof. We first show that the result holds for G = F n , the free group on n generators. 
Consider F n as the fundamental group 7Ti(£i n _i) of the genus 1 surface with n — 1 boundary 
components. Then by the work of [Hel], / induces a trace function, denoted by /', defined on 
5 , (£i iTJ ,_i). By theorem 1.2, there exists a representation p of the fundamental group 7ri(£i n _i) 
to SL(2,K) whose character is /'. Thus Xp( x ) = f( x ) f° r eac h x £ 7Ti(£i,n-i) which has a 
simple loop representative. Now by the remark following corollary 2.2, / is the character of p 
on G. 

for 7Ti(£i n _i) so that all elements Xi 1 Xi 2 ...Xi k 1 < i\ < i^ < < %k < n, 1 < k < n, are 
represented by simple loops. 

required property. Fig. 
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For the general n-generator group G, we follow an observation of Gonzalez-Acuna and 
Montesinos-Amilibia [GM]. Let : F n — > G be an epimorphism with ker(4>) = H. Then 
g = f o (p is a K-tra.ce function defined on F n . Thus there exists a representation p of _F n whose 
character is g. Furthermore, by the construction trp(x) = 2 for all x G H. Now we use the 
following lemma of [GM]. 

Lemma ([GM]). Suppose p : F n =< xi, x n >— > SL(2, K) is a representation and x G F n 
so that trp(x) = 2 and tr(p([x, Xj\) =2 for all i. Then either p(x) = id or p is reducible. 

Indeed, if p(x) ^ id, then p(x) has a unique eigenspace in K 2 . But tr(p([x,Xi\) = 2 shows 
that this eigenspace is invariant under all p(xi). Thus p is reducible. 

By the lemma, if p is irreducible, then p(x) = id for all x G H. In particular, the repre- 
sentation p induces a representation p' of G to SL{2, K) whose character is /. If p is reducible, 
we may replace p by its diagonalization p' without changing the character. Now tr(p'(x)) = 2 if 
and only if p'(x) = id. Thus the same argument goes through and we construct a representation 
whose character is /. □ 

8.2. We now prove theorem 1.1 for any group G. Let / be a X-trace function defined on 
G. We shall consider the following three cases: (1) there exist x, y G G so that f([x,y]) ^ 2, 
(2) for all x,y G G, f([x, y\) = 2 but there exists t G G so that f(t) ^ ±2, (3) for all x,y G G, 
/([x,y]) = 2and/(x) = ±2. 

In the first case, consider the subgroup < x,y > and restriction f\ <x ,y>- By lemma 2.3, 
there exists an irreducible representation p of < x, y > whose character is f\< x ,y>- Given any 
element z G G, consider the subgroup < x,y,z > and the restriction f\< x ,y,z>- By lemma 
2.3, there exists a representation p :< x,y,z >^ SL(2,K) so that its character is f\< x ,y,z>- 
Both p\ <x>y> and po have the same character and both are irreducible. By lemma 2.4, we may 
assume after conjugating p by an element in SL(2,K) so that p\ <x , y> = Po- We denote this 
representation by p 2 :< x,y,z >— > SL(2, K). Note that since p z is irreducible, p z is unique. Now 
define a map p, : G — > SL(2, K) by p,(z) = p z [z). Clearly tr(p(z)) = f(z) by the construction. 
We claim that p is a representation. Indeed, given z\,Z2 G G, consider the 4-generator subgroup 
< x, y, z\, Z2 > and the restriction f\< x ,y,z 1 ,z 2 >- By proposition 8.1, there exists a representation 
5 :< x, y, zi, Z2 >^ SL{2,K) whose character is f\< x , y , Zl ,z 2 >- By lemma 2.4, we may assume 
after conjugating by an element in SL(2, K) that 5\ <Xty> = po- Thus we obtain p Zi = 5\ <Xj y tZi> 
for % = 1,2. In particular this implies that p.{z\Z2) = p{z\)p,{z2). 

In the case (2), we consider the subgroup < x, y > where y = x so that f 2 (x) ^ 4. Let po 
be a diagonal representation of < x,y > whose character is f\< x , y >- Note that the assumption 
f([a,b]) = 2 implies the reducibility of the representations on all 2-generator subgroup. We go 
through the same argument as in the previous paragraph by taking all representations p z ,b~ to 
be diagonalizable. Since f 2 (x) ^ 4, by lemma 2.6, these representations are unique. Thus the 
result follows. 

Finally in the case (3), we have f(x) = ±2 and f([x,y]) = 2 for all x,y G G. If the 
characteristic of K is 2, then / = and / is the character of the trivial representation. If the 
characteristic of K is not 2, then by lemma 2.2 (b), we obtain f(xy) = f(x)f(y)/2. Define a 

representation p of G by p(x) = f^ x ^^ j^y^ ' ^en the character of p is /. □. 
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Remark. As the proof shows, theorem 1.1 follows as long as one establishes theorem 1.1 for 
the free group on 4 generators. 

§9. Some Questions 

There are some questions arising from the above considerations concerning the finite pre- 
sentations. It is shown in [Lul] and [Lu2] that there exists a finite set F C S(E) so that the 
Teichmuller space (respectively the space of measured laminations) of E is defined by the re- 
strictions of the length functions to F subject to a finite set of polynomial equations supported 
in level- 1 subsurfaces. The analogous question for the mapping class group of the surface seems 
to be open. Namely, whether the mapping class group has a finite presentation whose generators 
are finitely many Dehn twists and whose relations (in these generators) are supported in level- 1 
subsurfaces. A recent work of Gervais [Ge] shows that one can find a finite set of Dehn twists 
generating the mapping class group so that the relations (in these generators) are supported in 
level- 3 subsurfaces. Motivated by these, it is natural to ask if there exists a finite set F C S(E) 
so that SL(2,K) characters are determined by their restrictions to F subject to polynomial 
equations supported in level- 1 subsurfaces. The proofs in §4 and §6 strongly suggest that the 
answer is affirmative. If the answer is positive, it also implies that the character variety of any 
finitely generated group can be defined by the restrictions of the characters to a finite set of 
group elements subject to polynomial equations supported in 3-generator subgroups. The work 
of [GM] shows that the one can take the equations to be supported in 5-generator subgroups. 

There are several other related problems which seem to be intersting. The first question is 
that given a topological group and a complex valued continuous trace function on the group, is 
it the character of a continuous SL{2, C) representation of the group? The second question is 
whether theorem 1.1 remains true for the characters of GL(n, C) representations. To be more 
precise, suppose / is a complex valued function defined on the fundamental group of a surface so 
that the restriction of the function to each level- 1 subsurface group is a GL(2, C) character. Is 
there a GL(n, C) representation p of the fundamental group so that tr(p(x)) — f(x) for all x lying 
in some level- 1 subsurface? The third question is motivated by Royden's theorem [Ro] for the 
Teichmuller spaces. Suppose <f> is an algebraic automorphism of the SL(2, C) character variety 
of a surface group preserving the peripheral structure. Is <p induced by a self-homeomorphism of 
the surface? Finally the analogous result to Jorgensen's discreteness criterion seems to be the 
following. Suppose p is a faithful representation of a closed surface group to SL(2, C) so that p 
is discrete when restricted to each level- 1 subsurface group. Is p discrete? 

Appendix : A Proof of Lemma 2.3 

Lemma 2.3. Suppose K is a field in which all quadratic equations with coefficients in K 
have roots in K. Given six numbers x±, X2, £3, x±2, X23 and X31 in K, there exist three matrices 
Ai, A2, and A 3 in SL(2,K) so that trAi = Xi and trAiAj = Xy, for i = 1,2,3 and = 
(1,2), (2,3), and (3,1). 

Proof. We divide the proof into three cases: in case 1, some Xi 7^ 2, in case 2, some Xij 7^ ±2, 
and in case 3, all x^s and x^-'s are ±2. 

Case 1. Some Xi 7^ ±2, say x\ 7^ ±2. Choose A in K so that x\ = A + A -1 . Clearly A 7^ ±1. 
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Let A 1 = ^ A" 1 )' ^ 2 = (c d)' and ^ 3 = (z w) be three ^(2) matrices - We wil1 
find a,b,c,d,x,y,z,w in X solving the trace equations. By tr^2 = £2 and trA\A2 = x\2, we 
obtain a + d = xi and Xa + A _1 d = x\2- Because A 7^ ±1, we can solve this system of linear 
equations uniquely in a, d in K. Similarly, by trAs = X3 and trA^Ai = X31, we also solve 
x, w uniquely in K. It remains to find 6, c, y, z in K so that 6c = ad — 1, j/z = — 1 and 
trA 2 A 3 = £23, i-e., cy + bz = X23 — ax — dtu. If ad — 1 7^ 0, i.e., be 7^ 0, choose 6 = 1. Let 
c = ad — 1. Now, due to be 7^ 0, cy + bz = X23 — ax — dw and yz = xw — 1 can be solved in 
terms of y, z. If ad — 1 = 0, there are two more subcases: p = X23 — ax — dw 7^ or p = 0. If 
p = 0, we take b = c = and choose any pair y, z so that yz = xw — 1. If p 7^ 0, choose 6=1, 
c = 0. Then we have z = p and j/ = (xty — 1) /p. Thus, in all cases, we find three matrices 
in SX(2, K) satisfying the trace equations. 

Case 2. Some Xij 7^ ±2, say X12 7^ ±2. Then by case 1 applied to the six ordered numbers 
{^12,^2,^2^3 — ^23,^1,^31,^2^3 ~~ ^2^23 — £3}, we find three SL(2,K) matrices £?i,I?2, and 
B3 so that trB\ = x\2, trB2 = X2, and tri?3 = X2X3 — £23, trB\B2 = xi, trB\B3 = X13 and 
tri?2-B3 = X2X3 — X2X23 — X3. (Indeed, we take Bi = AiA 2l B 2 = A^ 1 and B3 = A^ 1 A3 to find 
the six numbers). Now let A\ = -B1-B2, A 2 = B^ 1 and A3 = B^ X B3. By the basic trace identity 
(lemma 2.2(a)), it follows that trAi = Xi and trAiAj = x^. 

Case 3. All x^s and a^'s are ±2. First we note that if trAi = Xi and trAiAj = x^, 
then (—Ai, A2, A3) solves the problem for the six numbers {— xi, X2, x%, —X12, £23, — X31}. Thus, 
by changing the signs of x^s if necessary, we may assume that x\ = X2 = X3 = 2. There 
are four cases for (x\, X2, X2, #12, ^23, #31) up to symmetry: (2,2,2,2,2,2), (2,2,2,-2,2,2), 
(2, 2, 2, —2, —2, 2) and (2, 2, 2, —2, —2, —2). The corresponding solutions are listed below. 

For (2,2,2,2,2,2), a solution (A 1 ,A 2 ,A 3 ) is (id, id, id). For (2,2,2,-2,2,2), a solution 
is( (o l)'(-4 l)'(o l) } - F ° r (2,2,2,-2,-2,2), a solution is ((j } ) > ( ^4 ?) > 

(j^ J)). Finally for (2, 2, 2, -2, -2, -2), a solution is (^ } ) ' ( ^4 l)'(l4 3)^ 

□ 
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